-- Logs begin at Wed 2022-08-24 08:14:00 UTC, end at Wed 2022-08-24 09:17:54 UTC. -- Aug 24 08:46:50.307595 dv-cinder-835384-23-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 08:46:50.316978 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 08:46:50.318943 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 08:46:50 2022] *** Aug 24 08:46:50.318943 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 08:46:50.318943 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 08:46:50.318943 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: nodename: dv-cinder-835384-23-iscsi Aug 24 08:46:50.318943 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: machine: x86_64 Aug 24 08:46:50.318943 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: clock source: unix Aug 24 08:46:50.318943 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: pcre jit disabled Aug 24 08:46:50.318943 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: detected number of CPU cores: 4 Aug 24 08:46:50.318943 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: current working directory: / Aug 24 08:46:50.318943 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: detected binary path: /usr/bin/uwsgi-core Aug 24 08:46:50.319623 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: your processes number limit is 47680 Aug 24 08:46:50.319623 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: your memory page size is 4096 bytes Aug 24 08:46:50.319623 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: detected max file descriptor number: 2048 Aug 24 08:46:50.319623 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: lock engine: pthread robust mutexes Aug 24 08:46:50.319623 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: thunder lock: enabled Aug 24 08:46:50.319623 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 08:46:50.319623 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 08:46:50.359087 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: Python main interpreter initialized at 0x5568717ab9c0 Aug 24 08:46:50.359087 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: python threads support enabled Aug 24 08:46:50.359087 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: your server socket listen backlog is limited to 100 connections Aug 24 08:46:50.359087 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: your mercy for graceful operations on workers is 90 seconds Aug 24 08:46:50.359507 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 08:46:50.359507 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: *** Operational MODE: preforking *** Aug 24 08:46:50.359783 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: *** uWSGI is running in multiple interpreter mode *** Aug 24 08:46:50.359783 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: spawned uWSGI master process (pid: 105506) Aug 24 08:46:50.360008 dv-cinder-835384-23-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 08:46:50.360596 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: spawned uWSGI worker 1 (pid: 105507, cores: 1) Aug 24 08:46:50.361421 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: spawned uWSGI worker 2 (pid: 105508, cores: 1) Aug 24 08:46:50.361421 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 08:46:51.032510 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 08:46:51.045777 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 08:46:52.129041 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:46:52.129041 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: from cryptography.utils import int_from_bytes Aug 24 08:46:52.129646 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:46:52.129646 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: from cryptography.utils import int_from_bytes Aug 24 08:46:52.130931 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:46:52.130931 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: from cryptography.utils import int_from_bytes Aug 24 08:46:52.131389 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:46:52.131389 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: from cryptography.utils import int_from_bytes Aug 24 08:46:54.712851 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 08:46:54.713542 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 08:46:54.713641 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 08:46:54.714001 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 08:46:54.714261 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 08:46:54.714655 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.714998 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.715327 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.715656 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.715992 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.716339 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.716666 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.716993 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.717326 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.717666 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.717992 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.718324 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-23-iscsi {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.718651 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.718970 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.719289 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.719612 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.719923 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.720286 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.720604 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.721115 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.721566 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.721884 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.722208 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.722553 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.722874 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.723191 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.723523 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.723841 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.724194 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.724511 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.724928 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-23-iscsi {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.725389 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.725586 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.725907 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.726335 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.726655 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.726970 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.727297 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.727626 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.727941 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.728311 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.728641 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.728964 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.729289 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.729597 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.729913 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.730229 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.730555 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.730868 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.731178 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.731435 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.731747 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.732074 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.732423 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.732747 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.733003 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.733780 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.734109 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.734440 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.734757 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.735075 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.735387 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.735705 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.736015 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.736363 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.736676 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.736996 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.737318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.737646 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.737974 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.738289 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.738614 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.739082 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.739280 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.739602 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.739952 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.740299 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.740620 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.741015 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.741255 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.741570 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.741885 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.742198 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.742524 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.742864 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.743177 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.743435 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.743746 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.744066 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.744413 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.744728 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.745042 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.745353 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.745662 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.745975 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.746287 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.746599 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.746911 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.747225 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.747539 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.747847 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.748187 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.748503 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.749523 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.749864 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.750181 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.750496 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.750812 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.751128 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.751455 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.751771 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.752086 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.752435 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.752749 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.753062 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.753392 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.753705 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.754024 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.754348 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.754657 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.754973 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.755293 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.755608 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.755925 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.756260 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.756575 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.756891 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.757192 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.757500 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.757812 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.758119 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.758440 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.758769 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.759086 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.759400 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.759712 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.760037 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.760410 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.760752 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.761102 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.761667 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.762064 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.762408 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.762739 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.763061 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.763385 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.763718 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.764046 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.764429 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.764752 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.765081 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.765409 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.765746 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.766072 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.766397 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.766726 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.767047 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.767375 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.767708 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.768040 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.768386 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.768735 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.769088 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.769412 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.769744 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.770076 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.770398 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.770717 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.771036 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.771368 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.771713 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.772036 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.772395 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.772717 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.773038 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.773358 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.773678 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.774005 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.774348 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.774673 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.774996 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.775316 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.775644 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.775964 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.776309 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.776629 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.776942 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.777252 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.777563 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.777880 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.778193 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.778519 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.778854 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.779169 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.779513 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.779823 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.780224 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.780542 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.780869 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.781177 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.781504 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.781821 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.782135 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.782469 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.782786 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.783105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.783435 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.783751 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.784065 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.784421 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.784739 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.785058 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.785378 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.785699 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.786031 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.786345 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 08:46:54.786849 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.786994 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 08:46:54.787134 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.787134 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.787411 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 08:46:54.787650 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.787805 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 08:46:54.787953 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.788148 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 08:46:54.788311 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.788461 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.788599 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.788737 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.788875 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.789021 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.789168 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.789306 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.789444 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.789581 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.789726 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.789871 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.790035 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.790176 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.790321 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.790459 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.790605 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.790743 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.790880 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.791016 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.791154 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.791301 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.791451 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.791591 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-23-iscsi {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.791729 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.791876 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.792014 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.792189 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.792343 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.792493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.792632 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.792777 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.792916 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.793070 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.793209 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.793348 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.793495 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.793633 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.793781 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.794002 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.794171 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.794311 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.794449 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.794586 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.794735 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.794873 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.795018 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.795164 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.795310 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.795461 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.796215 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.796431 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.796589 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.796797 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.796944 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.797119 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.797280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.797434 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.797574 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.797741 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.797882 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.798057 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.798217 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-23-iscsi {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.798380 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.798535 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.798708 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.798855 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.799012 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.799247 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.799408 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.799548 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.799703 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.799842 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.799979 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.800172 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.800329 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.800474 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.800630 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.800769 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.800907 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.801044 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.801241 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.801388 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.801551 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.801702 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.801878 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.802033 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.802183 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.802321 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.802504 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.802652 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.802822 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.802970 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.803117 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.803258 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.803431 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.803579 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.803726 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.803866 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.804026 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.804227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.804381 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.804520 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.804658 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.804796 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.804935 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.805080 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.805218 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.805355 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.805492 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.805634 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.805771 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.805930 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.806077 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.806228 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.806367 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.806505 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.806652 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.806847 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.807003 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.807149 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.807286 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.807424 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.807570 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.807727 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.807866 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.808005 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.808240 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.808416 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.808566 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.808713 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.808859 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.808997 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.809145 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.809285 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.809432 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.809579 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.809729 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.809916 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.810071 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.810228 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.810368 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.810505 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.810650 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.810789 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.810934 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.811080 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.811220 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.812572 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.813210 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.813362 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.813502 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.813655 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.813801 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.813946 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.814085 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.814223 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.814363 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.814523 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.814663 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.814810 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.814950 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.815110 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.815259 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.815399 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.815538 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.815676 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.815815 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.815961 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.816131 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.816550 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.816690 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.816829 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.816968 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.817106 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.817268 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.817417 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.817558 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.817696 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.817842 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.817842 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.818189 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.818331 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.818469 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.818608 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.818746 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.818893 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.819042 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.819206 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.819355 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.819494 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.819633 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.819781 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.819920 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.820058 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.820242 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.820392 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.820538 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.820688 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.820835 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.820974 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.821130 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.821270 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.821407 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.821555 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.821695 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.821840 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.821979 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.822129 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.822269 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.822425 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.822566 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.822706 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.822856 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.823003 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.823151 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.823298 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.823444 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.823583 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.823720 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.823865 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.824005 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.824177 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.824324 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.824480 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.824627 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.824783 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.824783 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.825058 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.825204 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.825343 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.825490 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.825628 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.825776 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.825916 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.826053 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.826198 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.826337 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.826337 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.826617 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.826757 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.826928 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.827124 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.827267 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.827407 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.827556 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.827705 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.827705 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.827980 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.828153 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.828299 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.828439 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.828608 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.828748 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.828895 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.829042 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.829189 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.829337 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.829477 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.829624 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.829770 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.829936 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.830084 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.830233 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.830386 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.830525 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.830664 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.830829 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.830976 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.831130 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:46:54.831281 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.831455 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.831599 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.831780 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.831934 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.832082 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.832286 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.832437 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.832577 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.832715 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.832862 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.833033 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.833181 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.833350 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.833498 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.833660 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.833813 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.833962 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.834099 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.834284 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.834462 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.834615 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.834763 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.834911 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.835050 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.835188 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.835334 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.835487 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.835627 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.835765 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.835903 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.836074 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.836274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.836427 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.836567 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.836706 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.836843 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.837019 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.837165 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.837316 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.837464 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.837628 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.837775 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.837955 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.838101 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.838280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.838429 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.838577 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.838714 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.838889 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.839036 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.839206 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.839361 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.839524 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.839677 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.839840 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.840004 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.840172 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.840338 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.840479 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.840625 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.840762 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.840913 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.841079 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.841226 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.841395 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.841540 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.841691 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.841838 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.841999 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.842169 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.842309 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.842589 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.843296 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.843523 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.843668 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.843668 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.843668 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.844065 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.844319 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.844462 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.844600 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.844740 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.844890 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.845030 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.845185 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.845370 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.845513 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.845513 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.845786 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.845933 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.846082 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.846220 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.846358 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.846504 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.846643 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.846792 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.846941 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.847081 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.847219 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.847357 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.847495 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.847651 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.847791 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.847938 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.848085 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.848255 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.848395 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.848546 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.848695 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.848847 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.848995 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.849134 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.849273 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.849420 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.849584 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.849740 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.849880 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.850044 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.850192 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.850379 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.850528 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.850680 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.850827 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.850973 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.851123 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.851262 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.851408 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.851554 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.851701 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.851862 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.852019 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.852222 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.852366 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.852516 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.852666 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.852806 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.852955 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.853096 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.853234 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.853391 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.853584 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.853762 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.853918 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.854067 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.854206 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.854345 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.854495 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.854648 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.854795 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.854935 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.855074 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.855225 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.855373 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.855520 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.855668 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.855808 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.855947 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.856086 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.856257 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.856422 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.856564 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.856703 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.856873 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.857021 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.857169 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.857322 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.857489 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.857648 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.857789 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.857941 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.858644 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.858795 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.859020 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.859166 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.859336 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.859546 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.859708 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.859875 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.860023 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.860233 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.860392 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.860535 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.860687 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.860827 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.860983 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.861123 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.861261 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.861399 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.861551 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.861690 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.861828 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.861978 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.862118 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.862269 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.862409 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.862549 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.862688 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.862861 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.863051 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.863207 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.863348 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.863495 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.863670 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.863818 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.863995 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.864182 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.864330 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.864514 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.864662 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.864801 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.865027 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.865178 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.865319 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.865457 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.865628 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.865785 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.865945 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.866089 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.866250 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.866397 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.866566 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.866722 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.866883 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.867041 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.867185 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.867331 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.867498 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.867648 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.867804 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.867951 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.868159 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.868314 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.868461 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.868631 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.868797 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.868953 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.869110 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.869263 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.869409 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.869554 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.869707 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.869853 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.870007 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.870153 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.870305 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.870459 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.870605 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.870758 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.870916 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.871129 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.871281 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.871440 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.871587 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.871741 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.871894 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.872041 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.872231 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.872464 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.872611 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.872763 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.872909 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.873067 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.873213 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.873366 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.873511 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.873689 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.874564 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.874712 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.874868 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.875022 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.875170 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.875316 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.875463 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.875608 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.875774 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.875928 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.876075 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.876303 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.876452 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.876616 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.876772 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.876918 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.877063 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.877218 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.877364 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.877508 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.877663 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.877828 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.877975 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.878120 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.878265 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.878423 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.878570 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.878727 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.878874 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.879020 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.879166 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.879320 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.879466 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.879622 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.879767 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.879921 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.880074 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.880262 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.880412 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.880558 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.880703 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.880848 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.880993 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.881151 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.881307 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.881460 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.881628 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.881782 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.881945 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.882092 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.882237 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.882383 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.882528 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.882673 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.882827 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.882973 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.883123 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.883277 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.883429 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.883587 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.883745 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.883892 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.884038 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.884233 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.884381 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.884526 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.884684 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.884831 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.884984 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.885131 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.885275 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.885430 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.885587 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.885734 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.885880 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.886032 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.886177 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.886338 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.886489 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.886635 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.886782 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.886927 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.887071 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.887226 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.887382 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.887535 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.887682 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.887828 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.887973 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.888157 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.888317 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.888465 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.888617 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.888765 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.888924 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.889078 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.889224 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.889414 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.889563 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.889764 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.889926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.890080 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.890232 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.890379 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.890532 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.890678 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.890831 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.890987 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.891132 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.891284 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.891453 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.891608 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.891767 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.891915 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.892059 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.892261 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.892409 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.892567 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.892721 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.892869 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.893015 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.893160 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.893306 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.893471 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.893627 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.893797 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.893951 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.894130 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.894284 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.894464 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.894618 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.894789 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.894942 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.895120 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.895273 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.895438 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.895583 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.895737 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.895882 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.896028 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.896249 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.896354 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.896452 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.896646 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.896754 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.896954 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.897045 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.897272 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.897370 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.897573 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.897749 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.897899 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.898053 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.898211 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.898365 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.898520 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.898673 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.898819 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.898965 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.899186 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.899336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.899507 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.899655 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.899815 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.899962 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.900174 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.900330 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.900478 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.900623 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.900769 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.900914 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.901072 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.901219 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.901373 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.901528 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.901674 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.901832 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.901987 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.902133 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.902280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.902426 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.902572 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.902726 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.902872 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.903017 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.903163 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.903318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.903464 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.903620 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.903775 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.903921 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.904073 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.904247 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.904406 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.904554 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.904706 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.904852 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.907504 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.907677 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.907790 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.907867 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.907935 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.907935 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.908070 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.908177 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.908265 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.908334 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.908401 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.908466 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.908537 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.908610 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.908693 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.908780 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.908849 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.908926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.909009 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.909109 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.909206 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.909303 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.909303 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.909423 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.909496 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.909496 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.909649 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.909728 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.909728 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.909876 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.909957 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.910118 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.910234 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.910422 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.910576 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.910730 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.910918 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.911044 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.911339 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.911582 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.911718 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.912057 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.912189 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.912436 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.912855 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.912957 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.913119 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.913209 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.913459 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.913656 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.913773 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.914085 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.914248 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.914402 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.914719 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.914821 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.915026 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.915361 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.915508 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.915672 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.915979 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.916075 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.916365 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.916442 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.916678 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.916754 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.916987 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.917078 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.917296 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.917432 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.917649 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.917766 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.917977 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.918076 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.918291 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.918377 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.918598 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.918685 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.918909 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.919003 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.919218 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.919314 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.919530 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.919615 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.919835 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.919935 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.920170 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.920272 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.920528 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.921160 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.921500 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.921657 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.921805 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.921966 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.922086 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.922271 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.922388 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.922607 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.922694 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.922943 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.923062 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.923271 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.923367 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.923598 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.923685 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.923933 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.924019 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.924275 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.924364 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.924589 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.924685 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.924914 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.925001 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.925233 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.925322 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.925544 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.925631 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.925861 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.925947 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.926174 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.926262 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.926483 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.926577 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.926795 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.926881 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.927101 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.927196 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.927427 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.927648 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.927736 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.928012 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.928132 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.928355 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.928453 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.928663 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.928749 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.928985 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.929083 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.929300 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.929387 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.929694 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.929801 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.929944 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.930037 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.930260 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.930347 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.930625 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.930720 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.930876 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.930964 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.931188 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.931276 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.931505 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.931691 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.931792 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.931866 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.932117 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.932216 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.932437 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.932539 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.932748 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.932835 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.933058 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.933144 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.933367 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.933465 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.933677 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.933769 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.933986 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.934073 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.934296 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.934392 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.934604 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.934695 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.934912 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.934998 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.935215 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.935303 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.935525 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.935610 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.935835 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.935921 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.936164 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.936298 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.937089 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.937244 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.937397 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.937544 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.937707 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.937797 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.938012 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.938099 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.938329 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.938453 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.938642 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.938768 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.938961 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.939083 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.939273 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.939390 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.939604 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.939692 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.939919 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.940026 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.940314 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.940417 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.940628 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.940733 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.940937 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.941031 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.941519 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.941754 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.941854 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.941937 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.942146 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.942242 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.942504 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.942600 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.942807 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.942893 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.943112 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.943371 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.943468 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.943717 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.943811 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.944025 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.944144 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.944359 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.944465 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.944666 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.944754 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.944987 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.945074 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.945291 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.945390 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.945611 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.945706 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.945962 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.946048 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.946281 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.946376 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.946601 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.946688 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.946920 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.947006 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.947238 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.947326 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.947555 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.947639 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.947874 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.947960 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.948220 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.948312 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.948540 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.948628 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.948844 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.948930 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.949156 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.949244 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.949464 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.949551 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.949776 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.949870 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.950094 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.950185 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.950404 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.950490 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.950718 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.950814 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.951023 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.951111 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.951345 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.951433 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.951665 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.951803 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.952025 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.952186 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.952371 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.952458 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.952838 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.952938 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.953161 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.953248 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.953481 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.953577 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.953800 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.953904 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.954124 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.954210 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.954439 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.954525 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.954748 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.954836 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.955062 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.955148 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.955370 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.955496 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.955677 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.955820 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.955999 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.956172 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.956330 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.956501 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.956644 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.956817 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.956955 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.957146 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.957265 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.957475 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.957569 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.957792 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.957880 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.958120 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.958207 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.958438 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.958525 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.958764 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.958856 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.959080 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.959167 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.959403 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.959497 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.959731 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.959817 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.960039 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.960221 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.960385 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.960472 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.960693 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.960779 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.961001 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.961101 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.961308 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.961399 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.961615 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.961709 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.961924 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.962018 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.962234 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.962321 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.962553 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.962639 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.962914 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.963017 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.963177 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.963265 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.963486 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.963584 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.963796 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.963884 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.964123 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.964260 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.964438 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.964525 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.964753 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.964853 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.965061 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.965160 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.965363 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.965457 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.965665 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.965753 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.965972 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.966072 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.966269 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.966365 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.966573 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.966719 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.966874 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.966962 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.967176 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.967271 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.967521 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.967688 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.967834 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.967990 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.968180 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.968354 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.968504 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.968621 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.968738 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.968942 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.969059 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.969272 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.969360 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.969592 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.969683 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.969919 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.970015 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.970236 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.970325 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.970566 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.970661 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.970868 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.971028 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.971195 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.971318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.971504 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.971592 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.971827 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.971923 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.972166 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.972259 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.972483 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.972560 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.972799 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.972897 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.973110 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.973196 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.973424 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.973509 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.973738 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.973826 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.974052 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.974140 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.974362 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.974456 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.974676 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.974765 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.974989 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.975077 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.975303 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.975390 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.975635 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.975865 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.975953 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.976221 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.976312 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.976539 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.976639 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.976853 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.976941 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.977168 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.977255 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.977537 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.977630 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.977858 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.977945 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.978176 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.978271 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.978493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.978581 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.978807 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.978894 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.979117 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.979210 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.979439 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.979525 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.979760 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.979835 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.980083 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.980217 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.980442 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.980529 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.980760 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.980842 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.981076 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.981171 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.981391 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.981477 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.981705 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.981793 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.982049 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.982190 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.982362 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.982460 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.982669 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.982756 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.982985 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.983582 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.983927 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.984082 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.984273 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.984443 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.984574 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 08:46:54.984742 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.985058 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.985376 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.985693 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.986005 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.986317 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.986630 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.986944 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.987266 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.987601 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.987924 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.988264 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.988580 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.988895 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.989431 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.989746 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.990078 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.990401 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.990722 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.991039 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.991355 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.991678 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.991980 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.992308 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.992620 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.992928 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.993231 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.993840 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.993840 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.994147 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.994465 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.994774 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.995310 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.995655 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.995977 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.996325 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.996652 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.996968 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.997319 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.997593 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.997899 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.998300 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.998502 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.999503 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:54.999943 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.000288 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.000603 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.000916 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.001222 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.001532 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.001838 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.002165 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.002473 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.002775 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.003078 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.003390 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.003695 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.004000 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.004326 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.004631 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.004942 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.005245 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.005553 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.005856 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.006167 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.006476 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.006778 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.007212 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.007402 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.007704 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.008189 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.008405 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.008714 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.009036 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.009349 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.009671 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.010013 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.010330 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.010882 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.011214 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.011532 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.011867 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.012231 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.012545 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.012851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.013157 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.013481 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.013793 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.014117 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.014450 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.014759 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.015167 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.015366 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.015680 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.015992 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.016328 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.016639 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.016950 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.017258 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.017905 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.017905 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.018196 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.018512 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.018891 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.019130 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.019450 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.019807 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.020080 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.020411 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.020782 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.021031 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.021348 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.021738 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.021975 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.022280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.022706 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.023017 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.023336 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.023654 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.023963 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.024310 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.024629 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.024939 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.025281 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.025572 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.025897 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.026234 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.026562 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.026885 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.027191 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.027493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.027798 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.028118 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.028445 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.028754 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.029055 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.029355 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.029671 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.030003 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.030309 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.030612 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.030915 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.031221 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.031521 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.031822 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.032141 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.032446 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.032748 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.033046 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.033350 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.033651 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.033953 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.034253 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.034561 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.034855 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.035187 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.035520 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.035954 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.036156 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.036570 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.036795 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.037090 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.037412 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.037734 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.038057 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.038375 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.038710 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.039015 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.039327 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.039675 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.039960 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.040295 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.040605 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.040937 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.041265 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.041583 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.041908 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.042232 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.042552 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.042868 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.043179 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.043507 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.043817 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.044158 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.044474 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.044798 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.045088 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.045456 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.046370 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.046738 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.047062 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.047384 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.047719 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.048046 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.048388 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.048715 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.049042 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.049395 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.049710 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.050066 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.050394 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.050709 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.051021 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.051326 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:46:55.051573 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 08:46:55.141421 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO dbcounter [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] Registered counter for database nova_api Aug 24 08:46:55.164141 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_db.sqlalchemy.engines [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:46:55.171506 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writer thread running {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:46:55.207903 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO dbcounter [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] Registered counter for database nova_api Aug 24 08:46:55.229108 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG oslo_db.sqlalchemy.engines [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:46:55.231630 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.context [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),494397f8-d04d-4a37-97c3-122ec902df53(cell1) {{(pid=105507) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 08:46:55.235589 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:46:55.235972 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writer thread running {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:46:55.236082 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:46:55.237705 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:46:55.238465 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:46:55.238909 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:46:55.240961 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:46:55.242975 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO dbcounter [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] Registered counter for database nova_cell0 Aug 24 08:46:55.248641 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO dbcounter [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] Registered counter for database nova_cell1 Aug 24 08:46:55.257107 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_db.sqlalchemy.engines [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:46:55.259522 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_db.sqlalchemy.engines [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:46:55.268247 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writer thread running {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:46:55.268601 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writer thread running {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:46:55.292897 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.context [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),494397f8-d04d-4a37-97c3-122ec902df53(cell1) {{(pid=105508) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 08:46:55.296991 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG oslo_concurrency.lockutils [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:46:55.297467 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG oslo_concurrency.lockutils [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:46:55.299058 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG oslo_concurrency.lockutils [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:46:55.299777 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG oslo_concurrency.lockutils [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:46:55.300247 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG oslo_concurrency.lockutils [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:46:55.302238 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG oslo_concurrency.lockutils [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105508) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:46:55.304256 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO dbcounter [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] Registered counter for database nova_cell0 Aug 24 08:46:55.309771 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO dbcounter [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] Registered counter for database nova_cell1 Aug 24 08:46:55.317835 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG oslo_db.sqlalchemy.engines [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:46:55.318991 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG oslo_db.sqlalchemy.engines [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:46:55.325685 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writer thread running {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:46:55.327726 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writer thread running {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:46:55.416334 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO dbcounter [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] Registered counter for database nova_cell0 Aug 24 08:46:55.423820 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_db.sqlalchemy.engines [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:46:55.428618 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writer thread running {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:46:55.474806 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO dbcounter [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] Registered counter for database nova_cell0 Aug 24 08:46:55.487165 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG oslo_db.sqlalchemy.engines [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:46:55.492148 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writer thread running {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:46:55.770531 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: WARNING keystonemiddleware.auth_token [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 08:46:55.777912 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: WARNING keystonemiddleware.auth_token [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 08:46:55.808527 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: WARNING keystonemiddleware.auth_token [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 08:46:55.816738 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: WARNING keystonemiddleware.auth_token [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 08:46:56.127325 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: WARNING keystonemiddleware.auth_token [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 08:46:56.133347 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: WARNING keystonemiddleware.auth_token [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 08:46:56.138676 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5568717ab9c0 pid: 105507 (default app) Aug 24 08:46:56.141160 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:46:56.142354 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001908 Aug 24 08:46:56.142777 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 788 bytes} [Wed Aug 24 08:46:56 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:46:56.163535 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: WARNING keystonemiddleware.auth_token [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 08:46:56.169648 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: WARNING keystonemiddleware.auth_token [None req-8e1f0762-082b-4d63-ad08-e03b53565ec0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 08:46:56.175582 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5568717ab9c0 pid: 105508 (default app) Aug 24 08:48:15.985510 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:15.987337 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002082 Aug 24 08:48:15.987879 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 2/2] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 24 08:48:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:16.000464 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writing DB stats nova_api:SELECT=3 {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:16.001704 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writing DB stats nova_cell1:SELECT=3 {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:16.003008 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writing DB stats nova_cell0:SELECT=3 {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:16.003839 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writing DB stats nova_cell0:SELECT=3 {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:16.886141 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-619d3d8e-bda8-4a19-b4af-235cf2f8d498 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:16.919369 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-619d3d8e-bda8-4a19-b4af-235cf2f8d498 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.924101 Aug 24 08:48:16.924189 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 1/3] 10.222.0.67 () {60 vars in 1292 bytes} [Wed Aug 24 08:48:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:48:19.314152 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:19.315128 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-f5cbc0ea-e49b-4bb1-802b-a4fcf0cae406 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Aug 24 08:48:19.321705 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 3/4] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 24 08:48:19 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:19.764497 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-39ecdeb8-6e24-4ae9-bacb-71f24aa9cdae admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256", "disk": 1, "ram": 256}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:19.784417 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:48:19.784417 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: warnings.warn(msg) Aug 24 08:48:19.818796 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-39ecdeb8-6e24-4ae9-bacb-71f24aa9cdae admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496132 Aug 24 08:48:19.828811 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 2/5] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:48:19.835403 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_api:SELECT=3 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:19.837070 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_cell1:SELECT=3 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:19.837709 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_cell0:SELECT=3 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:19.838800 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:20.051020 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-82748b91-6f21-4da0-8bd4-0b92a0b0c00b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:20.059686 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:48:20.059686 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: warnings.warn(msg) Aug 24 08:48:20.126736 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-82748b91-6f21-4da0-8bd4-0b92a0b0c00b admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.297747 Aug 24 08:48:20.127245 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 4/6] 10.222.0.67 () {64 vars in 1336 bytes} [Wed Aug 24 08:48:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:48:22.529120 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-39ecdeb8-6e24-4ae9-bacb-71f24aa9cdae admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:22.530150 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-39ecdeb8-6e24-4ae9-bacb-71f24aa9cdae admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 24 08:48:22.530552 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 3/7] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 24 08:48:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:23.217214 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-7aef00a8-0cda-4556-a7ac-7d880a4ba4ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:23.235861 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:48:23.235861 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: warnings.warn(msg) Aug 24 08:48:23.258654 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-7aef00a8-0cda-4556-a7ac-7d880a4ba4ff admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.721270 Aug 24 08:48:23.259312 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 5/8] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:48:23.271709 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-033e51ed-6adc-4b24-945b-f833792de21d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:23.274689 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:48:23.274689 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: warnings.warn(msg) Aug 24 08:48:23.308521 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-033e51ed-6adc-4b24-945b-f833792de21d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040671 Aug 24 08:48:23.309215 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 4/9] 10.222.0.67 () {64 vars in 1336 bytes} [Wed Aug 24 08:48:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:48:25.715426 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-7aef00a8-0cda-4556-a7ac-7d880a4ba4ff admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:25.716434 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-7aef00a8-0cda-4556-a7ac-7d880a4ba4ff admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 24 08:48:25.716841 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 6/10] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 24 08:48:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:26.132659 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-3dc1115f-d092-4a69-881b-1933c587f249 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G"}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:26.152001 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-3dc1115f-d092-4a69-881b-1933c587f249 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.426996 Aug 24 08:48:26.152828 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 5/11] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:48:26.165059 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-7a1fdda4-4448-4b3a-a452-7185e1c1d2bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:26.189929 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-7a1fdda4-4448-4b3a-a452-7185e1c1d2bc admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028907 Aug 24 08:48:26.190511 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 7/12] 10.222.0.67 () {64 vars in 1336 bytes} [Wed Aug 24 08:48:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:48:28.587194 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-3dc1115f-d092-4a69-881b-1933c587f249 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:28.588537 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-3dc1115f-d092-4a69-881b-1933c587f249 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 08:48:28.588950 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 6/13] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 24 08:48:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:29.077134 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-a8e69c9a-57a1-4d19-b5e2-02431a445d38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "id": "d3", "swap": 0, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:29.100167 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-a8e69c9a-57a1-4d19-b5e2-02431a445d38 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.505142 Aug 24 08:48:29.101227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 8/14] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:48:29.114724 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-dba56571-f058-45dc-8ee1-b396fffd36ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:29.145527 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-dba56571-f058-45dc-8ee1-b396fffd36ef admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035697 Aug 24 08:48:29.160141 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 7/15] 10.222.0.67 () {64 vars in 1336 bytes} [Wed Aug 24 08:48:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:48:31.555040 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-a8e69c9a-57a1-4d19-b5e2-02431a445d38 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:31.556042 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-a8e69c9a-57a1-4d19-b5e2-02431a445d38 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 24 08:48:31.556790 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 9/16] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 24 08:48:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:32.071074 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-2e5fa635-df8c-45ac-8b38-17f8c59aebf4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "swap": 0, "vcpus": 4}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:32.100149 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-2e5fa635-df8c-45ac-8b38-17f8c59aebf4 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.536276 Aug 24 08:48:32.101124 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 8/17] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 08:48:32.117297 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-337cdd1c-d56c-431f-974f-c82d17747750 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:32.143684 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-337cdd1c-d56c-431f-974f-c82d17747750 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032305 Aug 24 08:48:32.144793 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 10/18] 10.222.0.67 () {64 vars in 1336 bytes} [Wed Aug 24 08:48:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:48:34.603672 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-2e5fa635-df8c-45ac-8b38-17f8c59aebf4 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:34.604838 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-2e5fa635-df8c-45ac-8b38-17f8c59aebf4 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 Aug 24 08:48:34.605319 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 9/19] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 24 08:48:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:35.055267 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-58545486-4ea0-46fd-a246-8503cf4b3f20 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:35.082956 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-58545486-4ea0-46fd-a246-8503cf4b3f20 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.470392 Aug 24 08:48:35.083458 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 11/20] 10.222.0.67 () {60 vars in 1292 bytes} [Wed Aug 24 08:48:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:48:37.937808 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-2e5fa635-df8c-45ac-8b38-17f8c59aebf4 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:37.938858 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-2e5fa635-df8c-45ac-8b38-17f8c59aebf4 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 24 08:48:37.939270 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 10/21] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 24 08:48:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:38.451196 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-0a1c3ef0-2f62-4c05-a24a-c8b4f41326b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "ram": 512, "disk": 1, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:38.471175 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-0a1c3ef0-2f62-4c05-a24a-c8b4f41326b7 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.523824 Aug 24 08:48:38.471741 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 12/22] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:48:38.484361 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-9d59b945-534a-461d-a02c-9ee243167ecb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:38.512938 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-9d59b945-534a-461d-a02c-9ee243167ecb admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032382 Aug 24 08:48:38.513555 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 11/23] 10.222.0.67 () {64 vars in 1333 bytes} [Wed Aug 24 08:48:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:48:40.911391 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-0a1c3ef0-2f62-4c05-a24a-c8b4f41326b7 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:40.912710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-0a1c3ef0-2f62-4c05-a24a-c8b4f41326b7 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002230 Aug 24 08:48:40.913287 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 24 08:48:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:41.371470 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-35e4b5db-de73-49cb-ada1-93380ea32247 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:41.397384 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-35e4b5db-de73-49cb-ada1-93380ea32247 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.476369 Aug 24 08:48:41.397945 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 12/25] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:48:41.412215 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-1a70f792-9dbc-48fb-a6ee-dde098f08a37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:41.442479 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-1a70f792-9dbc-48fb-a6ee-dde098f08a37 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034055 Aug 24 08:48:41.443107 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 14/26] 10.222.0.67 () {64 vars in 1333 bytes} [Wed Aug 24 08:48:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:48:43.904283 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-35e4b5db-de73-49cb-ada1-93380ea32247 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:43.906235 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-35e4b5db-de73-49cb-ada1-93380ea32247 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002460 Aug 24 08:48:43.906770 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 13/27] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 24 08:48:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:44.311304 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-eeb34a9a-f29f-45f2-917a-297309b8c953 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:44.335102 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-eeb34a9a-f29f-45f2-917a-297309b8c953 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.421150 Aug 24 08:48:44.335656 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 15/28] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:48:44.348385 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-e3718dfa-82af-4bef-b69c-407c93db6f61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:44.383871 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-e3718dfa-82af-4bef-b69c-407c93db6f61 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039709 Aug 24 08:48:44.388741 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 14/29] 10.222.0.67 () {64 vars in 1333 bytes} [Wed Aug 24 08:48:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:48:46.908561 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-eeb34a9a-f29f-45f2-917a-297309b8c953 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:46.909588 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-eeb34a9a-f29f-45f2-917a-297309b8c953 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 24 08:48:46.910001 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 16/30] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 24 08:48:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:47.407555 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-68736cd3-177b-4d62-ae16-a99eb5be2e10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "id": "4"}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:47.413577 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:47.433887 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-68736cd3-177b-4d62-ae16-a99eb5be2e10 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.517097 Aug 24 08:48:47.434847 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 15/31] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:48:47.447322 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-da990dd6-948b-4608-a510-365199df03f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:47.474161 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-da990dd6-948b-4608-a510-365199df03f8 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030420 Aug 24 08:48:47.475081 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 17/32] 10.222.0.67 () {64 vars in 1333 bytes} [Wed Aug 24 08:48:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:48:49.877842 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-68736cd3-177b-4d62-ae16-a99eb5be2e10 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:48:49.880239 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-68736cd3-177b-4d62-ae16-a99eb5be2e10 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 Aug 24 08:48:49.880979 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 16/33] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 24 08:48:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:48:50.370789 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-c818c113-da9c-4c2f-9edc-1893986c6a91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "id": "5", "disk": 160}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:50.380820 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:50.398702 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-c818c113-da9c-4c2f-9edc-1893986c6a91 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.511264 Aug 24 08:48:50.399544 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 18/34] 10.222.0.67 () {64 vars in 1283 bytes} [Wed Aug 24 08:48:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:48:50.413007 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-289efdd9-56dc-46c4-b722-70b6e410ece9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:48:50.448545 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-289efdd9-56dc-46c4-b722-70b6e410ece9 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040143 Aug 24 08:48:50.460572 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 17/35] 10.222.0.67 () {64 vars in 1333 bytes} [Wed Aug 24 08:48:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:49:09.660735 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-c818c113-da9c-4c2f-9edc-1893986c6a91 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:09.662299 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-c818c113-da9c-4c2f-9edc-1893986c6a91 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 24 08:49:09.662723 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 19/36] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 24 08:49:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:09.673195 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:10.061102 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-31689662-9d16-410b-81be-e3b22485a3e9 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:10.079749 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-31689662-9d16-410b-81be-e3b22485a3e9 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.410889 Aug 24 08:49:10.080322 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 18/37] 10.222.0.67 () {60 vars in 1292 bytes} [Wed Aug 24 08:49:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:49:11.139597 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-c818c113-da9c-4c2f-9edc-1893986c6a91 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:11.140639 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-c818c113-da9c-4c2f-9edc-1893986c6a91 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Aug 24 08:49:11.141031 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 20/38] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 24 08:49:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:11.682156 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-3d185954-4032-4214-b775-bf060b0dbe0f admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:11.689510 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.wsgi [None req-3d185954-4032-4214-b775-bf060b0dbe0f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-3d185954-4032-4214-b775-bf060b0dbe0f admin admin] Request method failure captured: Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Accept: application/json Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Accept-Encoding: gzip, deflate Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Connection: keep-alive Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Content-Length: 0 Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Host: 10.222.0.67 Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Openstack-Api-Version: compute 2.90 Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Openstack-System-Scope: None Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: User-Agent: python-novaclient Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Auth-Token: gAAAAABjBeYHiaOynwb1sa179Q2HKBjSxxW-_UfokbN6iZkxczyiZ80ukSSxdIpElFHvVpJvQFZzRKnx3PuKTuhH2R1UXJajoooKpvPBE4OP4dP6sr5UlqfPfmakY_L_MKKkJmSnc23alNXjLA3qCFnkw_TVHUknJ1mlCsHfdNS-qBfzuJTOxh0 Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Domain-Id: None Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Domain-Name: None Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Identity-Status: Confirmed Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Is-Admin-Project: True Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Project-Domain-Id: default Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Project-Domain-Name: Default Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Project-Id: 456ae4386c984b51b020a86192cad430 Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Project-Name: admin Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Role: admin,reader,member Aug 24 08:49:11.694280 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Roles: admin,reader,member Aug 24 08:49:11.695895 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_456ae4386c984b51b020a86192cad430"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/456ae4386c984b51b020a86192cad430"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/456ae4386c984b51b020a86192cad430"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/456ae4386c984b51b020a86192cad430"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:49:11.695895 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Tenant: admin Aug 24 08:49:11.695895 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Tenant-Id: 456ae4386c984b51b020a86192cad430 Aug 24 08:49:11.695895 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Tenant-Name: admin Aug 24 08:49:11.695895 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-User: admin Aug 24 08:49:11.695895 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-User-Domain-Id: default Aug 24 08:49:11.695895 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-User-Domain-Name: Default Aug 24 08:49:11.695895 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-User-Id: d66e21fb9473433681e9a7a5e248373c Aug 24 08:49:11.695895 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-User-Name: admin Aug 24 08:49:11.695895 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: method: > Aug 24 08:49:11.695895 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: exception: Flavor 42 could not be found. Aug 24 08:49:11.695895 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: action_args: {'id': '42'} Aug 24 08:49:11.695895 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:49:11.695895 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:11.696962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Aug 24 08:49:11.698241 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-3d185954-4032-4214-b775-bf060b0dbe0f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:49:11.699486 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-3d185954-4032-4214-b775-bf060b0dbe0f admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.417296 Aug 24 08:49:11.699486 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 19/39] 10.222.0.67 () {60 vars in 1190 bytes} [Wed Aug 24 08:49:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:11.706758 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-6ecf7378-bcb5-4519-af3e-b823a204fd36 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:11.730987 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-6ecf7378-bcb5-4519-af3e-b823a204fd36 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027800 Aug 24 08:49:11.731569 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 21/40] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 24 08:49:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:49:11.742197 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-1932d8a2-00c2-4fd4-8fab-54f34e3fd7d6 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:11.766706 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-1932d8a2-00c2-4fd4-8fab-54f34e3fd7d6 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028895 Aug 24 08:49:11.767272 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 20/41] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 24 08:49:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:49:11.777252 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-d5071bc7-a766-4332-8086-2bd642d453f8 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:11.783062 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.wsgi [None req-d5071bc7-a766-4332-8086-2bd642d453f8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-d5071bc7-a766-4332-8086-2bd642d453f8 admin admin] Request method failure captured: Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Accept: application/json Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Accept-Encoding: gzip, deflate Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Connection: keep-alive Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Content-Length: 0 Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Host: 10.222.0.67 Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Openstack-Api-Version: compute 2.90 Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Openstack-System-Scope: None Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: User-Agent: python-novaclient Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Auth-Token: gAAAAABjBeYHiaOynwb1sa179Q2HKBjSxxW-_UfokbN6iZkxczyiZ80ukSSxdIpElFHvVpJvQFZzRKnx3PuKTuhH2R1UXJajoooKpvPBE4OP4dP6sr5UlqfPfmakY_L_MKKkJmSnc23alNXjLA3qCFnkw_TVHUknJ1mlCsHfdNS-qBfzuJTOxh0 Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Domain-Id: None Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Domain-Name: None Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Identity-Status: Confirmed Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Is-Admin-Project: True Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Project-Domain-Id: default Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Project-Domain-Name: Default Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Project-Id: 456ae4386c984b51b020a86192cad430 Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Project-Name: admin Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Role: admin,reader,member Aug 24 08:49:11.786336 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Roles: admin,reader,member Aug 24 08:49:11.788402 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_456ae4386c984b51b020a86192cad430"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/456ae4386c984b51b020a86192cad430"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/456ae4386c984b51b020a86192cad430"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/456ae4386c984b51b020a86192cad430"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:49:11.788402 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Tenant: admin Aug 24 08:49:11.788402 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Tenant-Id: 456ae4386c984b51b020a86192cad430 Aug 24 08:49:11.788402 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Tenant-Name: admin Aug 24 08:49:11.788402 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-User: admin Aug 24 08:49:11.788402 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-User-Domain-Id: default Aug 24 08:49:11.788402 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-User-Domain-Name: Default Aug 24 08:49:11.788402 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-User-Id: d66e21fb9473433681e9a7a5e248373c Aug 24 08:49:11.788402 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-User-Name: admin Aug 24 08:49:11.788402 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: method: > Aug 24 08:49:11.788402 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: exception: Flavor 42 could not be found. Aug 24 08:49:11.788402 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: action_args: {'id': '42'} Aug 24 08:49:11.788402 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:49:11.788402 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:11.789482 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 24 08:49:11.790784 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-d5071bc7-a766-4332-8086-2bd642d453f8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:49:11.792007 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-d5071bc7-a766-4332-8086-2bd642d453f8 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014670 Aug 24 08:49:11.792007 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 22/42] 10.222.0.67 () {60 vars in 1190 bytes} [Wed Aug 24 08:49:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:12.774404 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-1932d8a2-00c2-4fd4-8fab-54f34e3fd7d6 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:12.775417 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-1932d8a2-00c2-4fd4-8fab-54f34e3fd7d6 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 24 08:49:12.775815 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 21/43] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 24 08:49:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:13.308373 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-18882a52-ed72-4f34-9cd8-42942190357c admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:13.316349 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.wsgi [None req-18882a52-ed72-4f34-9cd8-42942190357c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-18882a52-ed72-4f34-9cd8-42942190357c admin admin] Request method failure captured: Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Accept: application/json Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Accept-Encoding: gzip, deflate Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Connection: keep-alive Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Content-Length: 0 Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Host: 10.222.0.67 Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Openstack-Api-Version: compute 2.90 Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Openstack-System-Scope: None Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: User-Agent: python-novaclient Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Auth-Token: gAAAAABjBeYIjD0cPwNCyyf5XvNjdy-kvkPIPweVDfMbLJVtCCJ8dBJbO8z2w4jsVA4usGckLtbiui_aWFTAXQZCR4mIMu6paYbx38P6stbP7u18PRCQrQ8TfyXiM3XmhaLq6PLP18PWI5lkRLYVNnjBnKGit-r5m87fN_eSHhEt1KHfoHpgUvg Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Domain-Id: None Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Domain-Name: None Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Identity-Status: Confirmed Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Is-Admin-Project: True Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Project-Domain-Id: default Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Project-Domain-Name: Default Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Project-Id: 456ae4386c984b51b020a86192cad430 Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Project-Name: admin Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Role: admin,reader,member Aug 24 08:49:13.317892 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Roles: admin,reader,member Aug 24 08:49:13.319640 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_456ae4386c984b51b020a86192cad430"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/456ae4386c984b51b020a86192cad430"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/456ae4386c984b51b020a86192cad430"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/456ae4386c984b51b020a86192cad430"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:49:13.319640 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Tenant: admin Aug 24 08:49:13.319640 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Tenant-Id: 456ae4386c984b51b020a86192cad430 Aug 24 08:49:13.319640 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Tenant-Name: admin Aug 24 08:49:13.319640 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-User: admin Aug 24 08:49:13.319640 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-User-Domain-Id: default Aug 24 08:49:13.319640 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-User-Domain-Name: Default Aug 24 08:49:13.319640 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-User-Id: d66e21fb9473433681e9a7a5e248373c Aug 24 08:49:13.319640 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-User-Name: admin Aug 24 08:49:13.319640 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: method: > Aug 24 08:49:13.319640 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: exception: Flavor 84 could not be found. Aug 24 08:49:13.319640 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: action_args: {'id': '84'} Aug 24 08:49:13.319640 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:49:13.319640 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:13.320710 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 24 08:49:13.322105 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-18882a52-ed72-4f34-9cd8-42942190357c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:49:13.323394 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-18882a52-ed72-4f34-9cd8-42942190357c admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.405208 Aug 24 08:49:13.323394 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 23/44] 10.222.0.67 () {60 vars in 1190 bytes} [Wed Aug 24 08:49:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:13.329467 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-e8b32661-bbbc-4f07-bec8-4884e3d1dddb admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:13.344935 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-e8b32661-bbbc-4f07-bec8-4884e3d1dddb admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019267 Aug 24 08:49:13.345470 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 22/45] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 24 08:49:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:49:13.355509 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-c2c1587f-70b4-49e9-8742-6c0965e7b321 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:13.370337 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-c2c1587f-70b4-49e9-8742-6c0965e7b321 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018276 Aug 24 08:49:13.370878 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 24/46] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 24 08:49:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:49:13.380215 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-a9d4a92b-db68-42be-b66d-0818e2cba084 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:13.385873 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.wsgi [None req-a9d4a92b-db68-42be-b66d-0818e2cba084 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-a9d4a92b-db68-42be-b66d-0818e2cba084 admin admin] Request method failure captured: Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Accept: application/json Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Accept-Encoding: gzip, deflate Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Connection: keep-alive Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Content-Length: 0 Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Host: 10.222.0.67 Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Openstack-Api-Version: compute 2.90 Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Openstack-System-Scope: None Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: User-Agent: python-novaclient Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Auth-Token: gAAAAABjBeYIjD0cPwNCyyf5XvNjdy-kvkPIPweVDfMbLJVtCCJ8dBJbO8z2w4jsVA4usGckLtbiui_aWFTAXQZCR4mIMu6paYbx38P6stbP7u18PRCQrQ8TfyXiM3XmhaLq6PLP18PWI5lkRLYVNnjBnKGit-r5m87fN_eSHhEt1KHfoHpgUvg Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Domain-Id: None Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Domain-Name: None Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Identity-Status: Confirmed Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Is-Admin-Project: True Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Project-Domain-Id: default Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Project-Domain-Name: Default Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Project-Id: 456ae4386c984b51b020a86192cad430 Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Project-Name: admin Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Role: admin,reader,member Aug 24 08:49:13.387393 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Roles: admin,reader,member Aug 24 08:49:13.388962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_456ae4386c984b51b020a86192cad430"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/456ae4386c984b51b020a86192cad430"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/456ae4386c984b51b020a86192cad430"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/456ae4386c984b51b020a86192cad430"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:49:13.388962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Tenant: admin Aug 24 08:49:13.388962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Tenant-Id: 456ae4386c984b51b020a86192cad430 Aug 24 08:49:13.388962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Tenant-Name: admin Aug 24 08:49:13.388962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-User: admin Aug 24 08:49:13.388962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-User-Domain-Id: default Aug 24 08:49:13.388962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-User-Domain-Name: Default Aug 24 08:49:13.388962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-User-Id: d66e21fb9473433681e9a7a5e248373c Aug 24 08:49:13.388962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-User-Name: admin Aug 24 08:49:13.388962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: method: > Aug 24 08:49:13.388962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: exception: Flavor 84 could not be found. Aug 24 08:49:13.388962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: action_args: {'id': '84'} Aug 24 08:49:13.388962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:49:13.388962 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:13.389926 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Aug 24 08:49:13.391278 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-a9d4a92b-db68-42be-b66d-0818e2cba084 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:49:13.392350 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-a9d4a92b-db68-42be-b66d-0818e2cba084 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012259 Aug 24 08:49:13.392350 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 23/47] 10.222.0.67 () {60 vars in 1190 bytes} [Wed Aug 24 08:49:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 08:49:14.369636 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-c2c1587f-70b4-49e9-8742-6c0965e7b321 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:14.370651 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-c2c1587f-70b4-49e9-8742-6c0965e7b321 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 24 08:49:14.371046 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 25/48] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 24 08:49:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:14.895830 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-ec9573b0-2103-4c7d-83c2-45b19cecd842 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:14.902463 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.wsgi [None req-ec9573b0-2103-4c7d-83c2-45b19cecd842 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-ec9573b0-2103-4c7d-83c2-45b19cecd842 admin admin] Request method failure captured: Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Accept: application/json Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Accept-Encoding: gzip, deflate Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Connection: keep-alive Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Content-Length: 0 Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Host: 10.222.0.67 Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Openstack-Api-Version: compute 2.90 Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Openstack-System-Scope: None Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: User-Agent: python-novaclient Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Auth-Token: gAAAAABjBeYKHSGhdjWctaqZ9C-ZP1qoNcVCTE85MN7JN-57BX6OsEE1F7u8q-T1FYWELJej-xQyRjKpW461h8mx5KoTAKFvr_MrP02vlLXxpokwm1SB40Pf6MnkmSB1zTXx6D4saqZPjNrAEKvvAD-XR6ZG9WBg154SvJ_UKO8AlBQdR2I47K8 Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Domain-Id: None Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Domain-Name: None Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Identity-Status: Confirmed Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Is-Admin-Project: True Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Project-Domain-Id: default Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Project-Domain-Name: Default Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Project-Id: 456ae4386c984b51b020a86192cad430 Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Project-Name: admin Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Role: admin,reader,member Aug 24 08:49:14.903948 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Roles: admin,reader,member Aug 24 08:49:14.905595 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_456ae4386c984b51b020a86192cad430"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/456ae4386c984b51b020a86192cad430"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/456ae4386c984b51b020a86192cad430"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/456ae4386c984b51b020a86192cad430"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:49:14.905595 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Tenant: admin Aug 24 08:49:14.905595 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Tenant-Id: 456ae4386c984b51b020a86192cad430 Aug 24 08:49:14.905595 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-Tenant-Name: admin Aug 24 08:49:14.905595 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-User: admin Aug 24 08:49:14.905595 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-User-Domain-Id: default Aug 24 08:49:14.905595 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-User-Domain-Name: Default Aug 24 08:49:14.905595 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-User-Id: d66e21fb9473433681e9a7a5e248373c Aug 24 08:49:14.905595 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: X-User-Name: admin Aug 24 08:49:14.905595 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: method: > Aug 24 08:49:14.905595 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: exception: Flavor 451 could not be found. Aug 24 08:49:14.905595 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: action_args: {'id': '451'} Aug 24 08:49:14.905595 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:49:14.905595 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:14.906493 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: ERROR nova.api.openstack.wsgi Aug 24 08:49:14.907851 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-ec9573b0-2103-4c7d-83c2-45b19cecd842 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105508) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:49:14.909300 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-ec9573b0-2103-4c7d-83c2-45b19cecd842 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.396563 Aug 24 08:49:14.909300 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 24/49] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 24 08:49:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:14.915547 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-19a5820c-6a58-4d64-845d-debc87bfee85 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:14.930329 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-19a5820c-6a58-4d64-845d-debc87bfee85 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018876 Aug 24 08:49:14.930859 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 26/50] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 24 08:49:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:49:14.940188 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-63404c79-c165-49c5-aabf-73d485aa8df1 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:14.955006 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-63404c79-c165-49c5-aabf-73d485aa8df1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018309 Aug 24 08:49:14.955529 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 25/51] 10.222.0.67 () {60 vars in 1210 bytes} [Wed Aug 24 08:49:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:49:14.965218 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-1f026f5d-922b-439f-af26-72479401638e admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:14.971423 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.wsgi [None req-1f026f5d-922b-439f-af26-72479401638e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-1f026f5d-922b-439f-af26-72479401638e admin admin] Request method failure captured: Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Accept: application/json Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Accept-Encoding: gzip, deflate Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Connection: keep-alive Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Content-Length: 0 Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Host: 10.222.0.67 Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Openstack-Api-Version: compute 2.90 Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Openstack-System-Scope: None Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: User-Agent: python-novaclient Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Auth-Token: gAAAAABjBeYKHSGhdjWctaqZ9C-ZP1qoNcVCTE85MN7JN-57BX6OsEE1F7u8q-T1FYWELJej-xQyRjKpW461h8mx5KoTAKFvr_MrP02vlLXxpokwm1SB40Pf6MnkmSB1zTXx6D4saqZPjNrAEKvvAD-XR6ZG9WBg154SvJ_UKO8AlBQdR2I47K8 Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Domain-Id: None Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Domain-Name: None Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Identity-Status: Confirmed Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Is-Admin-Project: True Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Project-Domain-Id: default Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Project-Domain-Name: Default Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Project-Id: 456ae4386c984b51b020a86192cad430 Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Project-Name: admin Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Role: admin,reader,member Aug 24 08:49:14.972227 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Roles: admin,reader,member Aug 24 08:49:14.973500 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_456ae4386c984b51b020a86192cad430"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/456ae4386c984b51b020a86192cad430"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/456ae4386c984b51b020a86192cad430"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/456ae4386c984b51b020a86192cad430"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:49:14.973500 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Tenant: admin Aug 24 08:49:14.973500 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Tenant-Id: 456ae4386c984b51b020a86192cad430 Aug 24 08:49:14.973500 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-Tenant-Name: admin Aug 24 08:49:14.973500 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-User: admin Aug 24 08:49:14.973500 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-User-Domain-Id: default Aug 24 08:49:14.973500 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-User-Domain-Name: Default Aug 24 08:49:14.973500 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-User-Id: d66e21fb9473433681e9a7a5e248373c Aug 24 08:49:14.973500 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: X-User-Name: admin Aug 24 08:49:14.973500 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: method: > Aug 24 08:49:14.973500 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: exception: Flavor 451 could not be found. Aug 24 08:49:14.973500 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: action_args: {'id': '451'} Aug 24 08:49:14.973500 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:49:14.973500 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:14.974318 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: ERROR nova.api.openstack.wsgi Aug 24 08:49:14.976274 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-1f026f5d-922b-439f-af26-72479401638e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:49:14.977495 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-1f026f5d-922b-439f-af26-72479401638e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011982 Aug 24 08:49:14.977495 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 27/52] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 24 08:49:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 08:49:15.941873 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-63404c79-c165-49c5-aabf-73d485aa8df1 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:15.942917 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-63404c79-c165-49c5-aabf-73d485aa8df1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 24 08:49:15.943387 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 26/53] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 24 08:49:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:16.481599 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-f9c34525-4e3d-41ec-8e46-c2ff33280f99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:49:16.500586 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-f9c34525-4e3d-41ec-8e46-c2ff33280f99 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.418554 Aug 24 08:49:16.501237 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 28/54] 10.222.0.67 () {64 vars in 1235 bytes} [Wed Aug 24 08:49:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:49:17.473906 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-63404c79-c165-49c5-aabf-73d485aa8df1 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:17.475429 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-63404c79-c165-49c5-aabf-73d485aa8df1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 Aug 24 08:49:17.475828 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 27/55] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 24 08:49:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:18.011981 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-2228e35e-a472-4ab1-8d0f-ed47843a6597 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:49:18.031049 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-2228e35e-a472-4ab1-8d0f-ed47843a6597 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.414066 Aug 24 08:49:18.031609 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 29/56] 10.222.0.67 () {64 vars in 1235 bytes} [Wed Aug 24 08:49:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 08:49:19.014291 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-63404c79-c165-49c5-aabf-73d485aa8df1 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:19.015289 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-63404c79-c165-49c5-aabf-73d485aa8df1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 24 08:49:19.015690 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 28/57] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 24 08:49:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:19.544773 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-7fb579cf-d87f-4a47-a812-54cbd4feb76f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:49:19.563579 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-7fb579cf-d87f-4a47-a812-54cbd4feb76f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.408736 Aug 24 08:49:19.564050 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 30/58] 10.222.0.67 () {64 vars in 1235 bytes} [Wed Aug 24 08:49:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:49:20.540807 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-63404c79-c165-49c5-aabf-73d485aa8df1 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:20.541821 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-63404c79-c165-49c5-aabf-73d485aa8df1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 24 08:49:20.542224 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 29/59] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 24 08:49:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:21.067358 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-93ed9d88-1a4c-423b-b1ed-e4bfc8099b2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:49:21.086717 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-93ed9d88-1a4c-423b-b1ed-e4bfc8099b2f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.406766 Aug 24 08:49:21.087259 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 31/60] 10.222.0.67 () {64 vars in 1235 bytes} [Wed Aug 24 08:49:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:49:22.061025 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-63404c79-c165-49c5-aabf-73d485aa8df1 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:22.062032 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-63404c79-c165-49c5-aabf-73d485aa8df1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 24 08:49:22.062457 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 30/61] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 24 08:49:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:49:22.602341 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-5d1da4ad-ef43-48c0-aba6-b03fe513cf11 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:49:22.623138 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-5d1da4ad-ef43-48c0-aba6-b03fe513cf11 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.409187 Aug 24 08:49:22.623608 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 32/62] 10.222.0.67 () {60 vars in 1202 bytes} [Wed Aug 24 08:49:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:50:16.932982 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-63404c79-c165-49c5-aabf-73d485aa8df1 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:50:16.933995 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-63404c79-c165-49c5-aabf-73d485aa8df1 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 24 08:50:16.934401 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 31/63] 10.222.0.67 () {54 vars in 931 bytes} [Wed Aug 24 08:50:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:50:16.945297 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:50:17.476795 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-9b265868-be4d-48cb-bc88-670871568190 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:50:17.497169 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-9b265868-be4d-48cb-bc88-670871568190 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.556251 Aug 24 08:50:17.497723 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 33/64] 10.222.0.67 () {60 vars in 1292 bytes} [Wed Aug 24 08:50:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:50:17.519088 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG dbcounter [-] [105508] Writing DB stats nova_api:SELECT=14 {{(pid=105508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:50:17.522908 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-7c4dda05-c034-4fc7-912b-1c8c583a7942 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:50:17.531795 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-7c4dda05-c034-4fc7-912b-1c8c583a7942 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014113 Aug 24 08:50:17.532373 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 32/65] 10.222.0.67 () {60 vars in 1283 bytes} [Wed Aug 24 08:50:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:50:17.544414 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-5e31186f-aae0-4318-80b0-d3568ec9ea97 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:50:17.552120 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-5e31186f-aae0-4318-80b0-d3568ec9ea97 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011526 Aug 24 08:50:17.552666 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 34/66] 10.222.0.67 () {60 vars in 1286 bytes} [Wed Aug 24 08:50:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:50:17.564521 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-3b816f83-c7e1-4608-8838-3f8e14feabe0 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:50:17.572877 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-3b816f83-c7e1-4608-8838-3f8e14feabe0 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011993 Aug 24 08:50:17.573399 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 33/67] 10.222.0.67 () {60 vars in 1286 bytes} [Wed Aug 24 08:50:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:50:17.585013 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-1ffdd737-334d-4796-a35b-f36857e21dcd admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:50:17.593486 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-1ffdd737-334d-4796-a35b-f36857e21dcd admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012273 Aug 24 08:50:17.594048 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 35/68] 10.222.0.67 () {60 vars in 1283 bytes} [Wed Aug 24 08:50:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:53:27.728507 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-3b816f83-c7e1-4608-8838-3f8e14feabe0 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:53:27.729606 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-3b816f83-c7e1-4608-8838-3f8e14feabe0 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Aug 24 08:53:27.730373 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 34/69] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 24 08:53:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:53:27.880236 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_api:SELECT=6 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:53:28.166958 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-cadb5e9f-4aa0-4046-bd7a-43b2440f26d1 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:53:28.169575 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:53:28.169575 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: warnings.warn(msg) Aug 24 08:53:28.170827 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-cadb5e9f-4aa0-4046-bd7a-43b2440f26d1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:53:28.171311 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-cadb5e9f-4aa0-4046-bd7a-43b2440f26d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:53:28.171743 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-cadb5e9f-4aa0-4046-bd7a-43b2440f26d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:53:28.172510 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-cadb5e9f-4aa0-4046-bd7a-43b2440f26d1 admin admin] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:53:28.172959 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-cadb5e9f-4aa0-4046-bd7a-43b2440f26d1 admin admin] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:53:28.173370 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-cadb5e9f-4aa0-4046-bd7a-43b2440f26d1 admin admin] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:53:28.220013 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-cadb5e9f-4aa0-4046-bd7a-43b2440f26d1 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.340893 Aug 24 08:53:28.221023 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 36/70] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 24 08:53:27 2022] GET /compute/v2.1/os-services => generated 794 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 08:53:29.328003 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-3b816f83-c7e1-4608-8838-3f8e14feabe0 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:53:29.329163 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-3b816f83-c7e1-4608-8838-3f8e14feabe0 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Aug 24 08:53:29.329777 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 35/71] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 24 08:53:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:53:29.617924 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-6d9a55e9-eda7-49b8-a031-90cef58789a0 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:53:29.621049 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:53:29.621049 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: warnings.warn(msg) Aug 24 08:53:29.622649 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6d9a55e9-eda7-49b8-a031-90cef58789a0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:53:29.623189 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6d9a55e9-eda7-49b8-a031-90cef58789a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:53:29.623669 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6d9a55e9-eda7-49b8-a031-90cef58789a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:53:29.624634 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6d9a55e9-eda7-49b8-a031-90cef58789a0 admin admin] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:53:29.625154 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6d9a55e9-eda7-49b8-a031-90cef58789a0 admin admin] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:53:29.625722 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-6d9a55e9-eda7-49b8-a031-90cef58789a0 admin admin] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:53:29.648607 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-6d9a55e9-eda7-49b8-a031-90cef58789a0 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.106657 Aug 24 08:53:29.649208 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 37/72] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 24 08:53:29 2022] GET /compute/v2.1/os-services => generated 794 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:53:40.977698 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-3b816f83-c7e1-4608-8838-3f8e14feabe0 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:53:40.978759 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-3b816f83-c7e1-4608-8838-3f8e14feabe0 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 24 08:53:40.979169 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 36/73] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 24 08:53:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:53:41.128986 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_cell0:SELECT=4 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:53:41.129587 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_cell1:SELECT=4 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:53:41.130181 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG dbcounter [-] [105507] Writing DB stats nova_api:SELECT=8 {{(pid=105507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:53:41.186258 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-21579e7c-3f2a-4516-936c-a4c9d2c7e0e1 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:53:41.188719 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:53:41.188719 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: warnings.warn(msg) Aug 24 08:53:41.189864 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-21579e7c-3f2a-4516-936c-a4c9d2c7e0e1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:53:41.190373 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-21579e7c-3f2a-4516-936c-a4c9d2c7e0e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:53:41.190810 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-21579e7c-3f2a-4516-936c-a4c9d2c7e0e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:53:41.191565 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-21579e7c-3f2a-4516-936c-a4c9d2c7e0e1 admin admin] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:53:41.192020 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-21579e7c-3f2a-4516-936c-a4c9d2c7e0e1 admin admin] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:53:41.192544 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-21579e7c-3f2a-4516-936c-a4c9d2c7e0e1 admin admin] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:53:41.218273 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-21579e7c-3f2a-4516-936c-a4c9d2c7e0e1 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.093854 Aug 24 08:53:41.218861 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 38/74] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 24 08:53:41 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:53:42.129352 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: DEBUG nova.api.openstack.wsgi [None req-3b816f83-c7e1-4608-8838-3f8e14feabe0 admin admin] Calling method '>' {{(pid=105508) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:53:42.130368 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: INFO nova.api.openstack.requestlog [None req-3b816f83-c7e1-4608-8838-3f8e14feabe0 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 24 08:53:42.130769 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: [pid: 105508|app: 0|req: 37/75] 10.222.0.67 () {56 vars in 1074 bytes} [Wed Aug 24 08:53:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:53:42.323484 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG nova.api.openstack.wsgi [None req-d677d241-7bf0-4110-a272-be6c2d5c08a9 admin admin] Calling method '>' {{(pid=105507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:53:42.325886 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:53:42.325886 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: warnings.warn(msg) Aug 24 08:53:42.326986 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-d677d241-7bf0-4110-a272-be6c2d5c08a9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:53:42.327469 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-d677d241-7bf0-4110-a272-be6c2d5c08a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:53:42.327899 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-d677d241-7bf0-4110-a272-be6c2d5c08a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:53:42.328654 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-d677d241-7bf0-4110-a272-be6c2d5c08a9 admin admin] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:53:42.329102 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-d677d241-7bf0-4110-a272-be6c2d5c08a9 admin admin] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:53:42.329524 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: DEBUG oslo_concurrency.lockutils [None req-d677d241-7bf0-4110-a272-be6c2d5c08a9 admin admin] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:53:42.352685 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: INFO nova.api.openstack.requestlog [None req-d677d241-7bf0-4110-a272-be6c2d5c08a9 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.082374 Aug 24 08:53:42.353255 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: [pid: 105507|app: 0|req: 39/76] 10.222.0.67 () {60 vars in 1193 bytes} [Wed Aug 24 08:53:42 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:54:42.763024 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: Wed Aug 24 08:54:42 2022 - graceful shutdown triggered... Aug 24 08:54:42.763916 dv-cinder-835384-23-iscsi devstack@n-api.service[105507]: Gracefully killing worker 1 (pid: 105507)... Aug 24 08:54:42.763249 dv-cinder-835384-23-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 08:54:42.765209 dv-cinder-835384-23-iscsi devstack@n-api.service[105508]: Gracefully killing worker 2 (pid: 105508)... Aug 24 08:54:43.764196 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: worker 1 buried after 1 seconds Aug 24 08:54:43.764196 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: worker 2 buried after 1 seconds Aug 24 08:54:43.764868 dv-cinder-835384-23-iscsi devstack@n-api.service[105506]: goodbye to uWSGI. Aug 24 08:54:43.765784 dv-cinder-835384-23-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 08:54:43.766340 dv-cinder-835384-23-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 08:54:43.769142 dv-cinder-835384-23-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 08:54:43.779978 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 08:54:43.782240 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 08:54:43 2022] *** Aug 24 08:54:43.782240 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 08:54:43.782240 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 08:54:43.782240 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: nodename: dv-cinder-835384-23-iscsi Aug 24 08:54:43.782240 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: machine: x86_64 Aug 24 08:54:43.782240 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: clock source: unix Aug 24 08:54:43.782240 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: pcre jit disabled Aug 24 08:54:43.782240 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: detected number of CPU cores: 4 Aug 24 08:54:43.782240 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: current working directory: / Aug 24 08:54:43.782240 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: detected binary path: /usr/bin/uwsgi-core Aug 24 08:54:43.782240 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: your processes number limit is 47680 Aug 24 08:54:43.782240 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: your memory page size is 4096 bytes Aug 24 08:54:43.782998 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: detected max file descriptor number: 2048 Aug 24 08:54:43.782998 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: lock engine: pthread robust mutexes Aug 24 08:54:43.782998 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: thunder lock: enabled Aug 24 08:54:43.782998 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 08:54:43.782998 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 08:54:43.824301 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: Python main interpreter initialized at 0x563cd741c9c0 Aug 24 08:54:43.824301 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: python threads support enabled Aug 24 08:54:43.824301 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: your server socket listen backlog is limited to 100 connections Aug 24 08:54:43.824301 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: your mercy for graceful operations on workers is 90 seconds Aug 24 08:54:43.824737 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 08:54:43.824737 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: *** Operational MODE: preforking *** Aug 24 08:54:43.825055 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: *** uWSGI is running in multiple interpreter mode *** Aug 24 08:54:43.825055 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: spawned uWSGI master process (pid: 120525) Aug 24 08:54:43.825262 dv-cinder-835384-23-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 08:54:43.827538 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: spawned uWSGI worker 1 (pid: 120542, cores: 1) Aug 24 08:54:43.827538 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: spawned uWSGI worker 2 (pid: 120543, cores: 1) Aug 24 08:54:43.827538 dv-cinder-835384-23-iscsi devstack@n-api.service[120525]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 08:54:44.590558 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 08:54:44.640622 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 08:54:45.865029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:54:45.865029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: from cryptography.utils import int_from_bytes Aug 24 08:54:45.865714 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:54:45.865714 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: from cryptography.utils import int_from_bytes Aug 24 08:54:45.905632 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:54:45.905632 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: from cryptography.utils import int_from_bytes Aug 24 08:54:45.905632 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:54:45.905632 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: from cryptography.utils import int_from_bytes Aug 24 08:54:48.337775 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 08:54:48.338369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 08:54:48.338516 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 08:54:48.338933 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 08:54:48.339159 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 08:54:48.339566 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.339902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.340454 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.340990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.342140 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.342140 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.342344 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.342499 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.342843 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.343117 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.343449 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.343788 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-23-iscsi {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.344198 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.344469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.344794 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.345134 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.345452 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.345787 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.346119 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.346639 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.347104 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.347429 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.347754 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.348125 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.348460 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.348781 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.349113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.349432 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.349799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.350108 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.350554 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-23-iscsi {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.350874 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.351179 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.351516 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.351964 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.353023 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.353023 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.353023 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.353269 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.353569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.353919 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.354239 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.354573 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.354907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.355659 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.356264 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.356778 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.357117 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.357437 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.357756 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.358021 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.358341 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.358856 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.359192 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.359529 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.359797 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.360055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.361025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.361025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.361025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.369598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.369598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.369598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.369598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.369598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.369598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.369598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.369598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.370265 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.370265 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.370265 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.370265 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.370265 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.370265 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.370265 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.370265 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.370894 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.370894 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.370894 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.370894 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.370894 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.370894 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.370894 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.370894 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.372305 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.372305 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.372305 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.372305 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.372305 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.372305 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.372305 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.372305 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.373291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.373291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.373291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.373291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.373291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.373970 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.373970 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.373970 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.374274 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.374586 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.374902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.375237 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.375576 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.375896 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.376244 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.376563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.376777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 08:54:48.377241 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.377344 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 08:54:48.377447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.377541 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.377626 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 08:54:48.377799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.377935 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 08:54:48.378132 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.378234 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 08:54:48.378620 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.378733 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.378820 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.378905 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.379088 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.379246 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.381139 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.381250 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.381330 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.381402 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.381490 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.381575 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.381648 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.381718 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.381795 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.381873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.381953 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.382032 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.382111 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.382190 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.382270 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.382350 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.382430 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.382502 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-23-iscsi {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.382578 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.382650 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.382730 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.382811 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.382883 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.383027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.383110 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.383551 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.383650 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.383740 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.383813 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.383960 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.384042 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.384312 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.384412 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.384634 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.384830 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.384935 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.385256 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.385365 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.385450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.385575 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.385748 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.388163 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.388387 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.388586 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.388750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.388893 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.389042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.389189 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.389362 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.389782 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.389938 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.390079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.390225 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.390433 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.390571 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.390737 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.390875 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-23-iscsi {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.391021 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.391163 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.391311 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.391567 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.391717 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.391853 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.391975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.392060 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.392226 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.392358 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.392444 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.392517 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.392587 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.392657 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.392736 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.392815 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.392886 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.392957 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.393033 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.393112 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.393195 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.393275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.393352 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.393423 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.393493 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.393563 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.393646 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.393725 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.393797 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.393866 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.394509 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.394675 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.394832 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.394982 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.394982 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.395281 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.395452 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.395608 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.395752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.395892 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.396041 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.396228 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.396374 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.396545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.396696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.396838 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.396985 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.397160 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.397316 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.397316 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.397599 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.400205 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.401530 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.401699 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.401849 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.401992 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.402157 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.402343 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.402532 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.402681 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.402958 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.403210 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.403452 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.403680 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.403842 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.403842 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.403842 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.404511 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.404670 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.404835 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.404988 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.405899 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.406058 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.406212 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.406355 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.406504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.406662 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.406813 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.406962 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.407105 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.407253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.407394 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.407562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.407562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.407562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.407562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.407562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.407562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.408867 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.409012 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.409154 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.409303 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.409454 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.409610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.409753 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.409912 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.409912 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.409912 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.409912 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.410472 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.410625 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.410766 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.410907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.411049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.411189 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.411342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.411491 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.411651 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.411793 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.411934 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.412085 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.412266 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.412424 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.412579 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.412868 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.413019 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.413177 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.413326 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.413477 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.413619 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.413778 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.413921 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.414075 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.414226 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.414374 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.414524 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.414665 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.414821 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.414971 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.415127 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.415291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.415590 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.415750 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.415930 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.416262 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.416429 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.416429 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.416708 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.416850 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.416999 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.417149 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.417309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.417459 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.417601 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.417749 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.417900 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.418068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.418231 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.418375 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.419176 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.419413 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.419567 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.419724 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.419867 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.420050 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.420229 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.420381 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.420524 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.420687 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.420829 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.420977 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.421119 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.421273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.421423 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.421566 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.421715 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.421857 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.422082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.422227 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.422388 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.422541 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.422695 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.422864 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.423105 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.423261 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.423411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.423560 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.423719 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.423872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.424014 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.424177 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.424338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.424481 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.424481 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.425016 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.425171 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.425357 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.425514 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.425814 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.425964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.426367 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.426703 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.426878 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.427023 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.427173 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.427352 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.427502 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.427672 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.427851 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.428004 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.428245 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.428408 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.428558 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.428708 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.428708 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.429673 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.429824 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.430016 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.430161 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.430309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.430471 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.430612 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.430753 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.430906 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.431049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.431191 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.431331 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:54:48.431472 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.431613 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.431770 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.431770 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.432048 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.432229 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.432383 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.432538 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.432688 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.432688 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.432969 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.432969 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.433376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.433376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.433705 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.433705 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.434519 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.434748 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.434996 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.435300 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.435472 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.435617 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.435758 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.436061 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.436061 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.436061 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.436061 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.436896 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.437054 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.437203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.437372 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.437515 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.437663 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.437813 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.437953 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.438104 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.438259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.438402 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.438693 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.438903 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.439297 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.439543 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.439701 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.439855 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.440004 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.440175 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.440332 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.440484 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.440658 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.440837 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.441019 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.441174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.441317 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.441317 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.441659 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.441827 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.441995 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.442154 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.442297 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.442297 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.442581 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.442740 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.442884 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.443033 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.443175 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.443348 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.443598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.443755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.443907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.444068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.444236 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.444396 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.444545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.444688 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.444828 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.444976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.445131 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.445273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.445420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.445563 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.445711 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.445852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.446016 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.446325 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.446481 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.446622 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.446771 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.446930 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.447218 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.447375 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.447531 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.447672 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.447813 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.447961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.448170 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.448331 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.448474 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.448623 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.448773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.448929 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.449078 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.451044 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.451325 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.451564 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.451564 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.451564 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.451564 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.451564 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.451564 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.451564 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.451564 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.453157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.453157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.453157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.453157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.453157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.453157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.453157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.455014 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.455160 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.455322 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.455491 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.455728 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.455876 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.456017 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.456218 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.456429 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.456606 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.456606 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.456997 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.457140 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.457434 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.457591 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.457747 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.457984 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.458135 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.458278 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.458278 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.458546 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.458686 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.458835 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.458975 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.459123 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.459272 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.459627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.459811 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.459958 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.460122 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.460122 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.460536 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.460678 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.460834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.460977 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.461118 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.461267 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.461419 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.461578 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.461739 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.461905 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.462055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.462226 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.462984 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.463139 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.463291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.463492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.463666 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.463840 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.463840 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.464214 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.464385 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.464652 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.464852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.464852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.465218 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.465452 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.465703 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.465943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.466165 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.466326 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.466477 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.466655 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.466823 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.467197 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.467197 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.467885 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.468041 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.468220 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.468376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.468555 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.468723 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.468867 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.469293 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.469443 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.469812 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.469971 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.470136 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.470304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.470577 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.470741 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.470899 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.471048 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.471205 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.471362 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.471510 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.471669 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.471828 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.471990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.472191 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.472347 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.472522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.472682 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.472830 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.472988 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.473144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.473300 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.473448 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.473596 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.473744 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.473900 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.474050 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.474197 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.474353 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.474514 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.477148 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.477472 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.477654 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.477812 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.477812 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.478264 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.478426 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.478593 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.478744 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.478894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.479043 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.479192 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.479363 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.479526 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.479674 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.480313 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.480313 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.481277 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.481486 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.481715 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.481954 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.482203 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.482411 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.482567 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.482741 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.482891 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.483048 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.483205 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.483356 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.483527 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.483691 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.483849 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.484005 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.484189 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.484353 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.484514 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.484663 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.484822 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.484971 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.485127 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.485276 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.485439 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.485598 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.485755 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.485911 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.486067 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.486217 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.486407 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.486608 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.486759 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.486989 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.487350 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.487979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.488450 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.488632 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.488792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.488943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.489099 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.489549 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.489716 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.489875 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.490205 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.490421 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.490626 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.490795 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.490947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.491096 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.491263 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.491530 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.491685 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.491856 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.492006 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.492187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.492341 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.492341 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.492715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.492908 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.493068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.493218 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.493368 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.493525 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.493707 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.493914 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.494147 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.494325 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.494484 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.494634 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.494792 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.495024 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.495024 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.495377 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.495560 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.495734 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.495902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.496053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.496371 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.496573 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.496821 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.497101 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.497357 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.497656 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.497831 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.498144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.498302 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.498701 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.498860 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.499019 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.499178 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.499381 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.499652 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.499652 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.499955 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.500135 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.500401 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.500577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.500730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.500893 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.501051 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.501208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.501358 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.501524 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.501799 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.501954 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.502111 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.502111 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.502111 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.502111 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.502111 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.502854 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.503012 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.503161 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.503318 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.503466 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.503627 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.503776 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.503924 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.504079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.504268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.504419 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.504596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.504753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.504902 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.505299 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.505456 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.505615 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.505800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.505800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.506090 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.506238 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.506395 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.506630 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.506791 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.506791 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.507096 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.507253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.507402 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.507559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.507837 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.508001 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.508174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.508469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.508650 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.508950 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.509107 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.509266 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.509427 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.509577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.509851 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.510007 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.510157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.510330 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.510610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.510773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.510929 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.511700 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.512565 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.512777 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.513036 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.513299 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.513560 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.513741 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.513894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.514050 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.514214 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.514372 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.514521 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.514670 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.514829 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.514987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.515137 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.515137 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.515433 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.515589 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.515589 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.515891 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.516050 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.516250 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.516409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.516558 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.516707 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.516871 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.517022 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.517170 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.517340 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.517489 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.517638 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.517818 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.518077 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.518243 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.518400 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.518708 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.518874 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.519170 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.519327 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.519477 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.519635 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.519820 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.520107 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.520282 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.520442 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.520616 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.520868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.521022 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.521187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.521344 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.521501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.521650 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.521806 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.521980 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.522138 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.522300 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.522450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.522736 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.522900 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.523058 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.523209 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.523359 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.523507 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.523663 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.523812 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.523974 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.524223 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.524382 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.524533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.524689 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.524689 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.524995 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.525146 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.525302 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.525458 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.525609 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.525765 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.525924 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.526083 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.526294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.526502 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.526664 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.527034 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.527034 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.527352 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.527649 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.527823 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.527823 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.528550 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.528905 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.529073 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.529392 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.529574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.529726 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.529891 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.530068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.530337 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.530492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.530651 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.530801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.531083 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.531241 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.531241 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.531576 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.531739 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.531898 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.532055 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.532233 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.532391 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.532551 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.532722 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.533001 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.533001 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.533303 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.533451 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.533608 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.533774 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.533950 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.534101 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.534250 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.534407 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.534556 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.534705 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.534863 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.535013 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.535163 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.535319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.535468 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.535625 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.535776 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.535951 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.535951 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.536313 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.536471 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.536629 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.536778 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.536936 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.537092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.537241 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.537397 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.537558 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.537708 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.537856 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.537856 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.538160 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.538322 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.538492 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.538748 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.539116 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.539306 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.539610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.539610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.539997 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.540166 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.540350 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.540605 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.540771 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.540937 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.541105 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.541364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.541364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.541653 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.541801 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.541801 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.542119 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.542277 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.542277 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.542561 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.542729 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.542729 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.543773 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.543991 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.544323 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.544576 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.544576 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.544992 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.545153 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.545153 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.545447 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.545652 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.545652 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.545983 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.546143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.546143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.546436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.546584 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.546584 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.546885 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.547041 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.547204 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.547354 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.547354 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.547354 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.547782 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.547949 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.548123 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.548279 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.548279 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.548578 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.548753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.548753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.549178 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.549470 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.549654 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.549957 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.549957 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.550255 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.550415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.550415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.550832 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.550986 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.550986 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.551373 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.551632 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.551803 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.551985 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.551985 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.552328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.552490 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.552665 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.552823 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.552980 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.553129 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.553129 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.553419 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.553718 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.553998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.554154 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.554154 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.554445 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.554608 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.554759 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.554928 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.555085 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.555234 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.555234 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.555531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.555680 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.555837 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.555994 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.555994 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.556306 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.556467 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.556624 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.556774 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.556774 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.557070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.557070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.557367 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.557516 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.557664 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.557814 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.557962 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.558110 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.558271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.558427 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.558586 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.559203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.559497 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.559689 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.559689 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.560395 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.560561 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.560720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.560992 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.561159 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.561311 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.561467 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.561467 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.561883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.562056 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.562225 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.562376 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.562376 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.562376 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.562376 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.562951 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.563110 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.563260 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.563408 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.563595 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.563772 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.563772 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.564244 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.564402 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.564560 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.564709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.564709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.565079 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.565239 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.565390 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.565538 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.565538 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.565833 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.565994 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.566144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.566294 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.566444 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.566600 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.566600 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.566896 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.567045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.567193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.567349 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.567349 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.567644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.567793 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.567961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.568135 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.568135 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.568439 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.568589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.568747 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.568896 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.568896 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.569187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.569350 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.569517 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.569783 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.569951 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.570400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.570558 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.570730 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.570730 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.571163 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.571163 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.571163 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.571603 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.571762 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.572037 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.572246 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.572398 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.572398 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.572708 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.572866 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.572866 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.573158 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.573314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.573463 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.573622 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.574000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.574000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.574989 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.574989 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.575421 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.575692 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.575957 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.576164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.576333 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.576484 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.576484 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.576780 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.576929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.576929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.577210 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.577367 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.577525 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.577674 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.577674 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.577979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.577979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.578262 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.578262 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.578556 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.578712 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.578871 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.579029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.579029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.579332 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.579492 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.579492 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.579933 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.580142 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.580142 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.580737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.580894 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.581052 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.581330 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.581330 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.581630 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.581789 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.581789 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.582194 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.582374 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.582374 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.582669 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.582819 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.582969 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.583126 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.583277 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.583425 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.583583 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.583583 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.583884 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.584042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.584230 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.584406 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.584557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.584706 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.584863 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.585159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.585323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.585323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.585626 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.585775 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.585775 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.586065 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.586065 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.586376 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.586544 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.586544 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.586845 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.587001 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.587158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.587322 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.587471 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.587621 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.587769 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.587769 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.588186 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.588186 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.588186 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.588648 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.588805 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.588955 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.589118 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.589275 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.589434 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.589591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.589747 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.589930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.590348 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.590617 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.591196 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.591491 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.591649 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.591798 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.591971 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.592146 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.592419 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.592574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.592744 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.592744 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.592744 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.593179 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.593328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.593485 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.593646 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.593810 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.593967 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.593967 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.594259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.594417 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.594576 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.594735 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.594892 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.595048 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.595338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.595502 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.595664 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.595823 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.595980 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.596231 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.596814 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.596967 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.597126 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.597276 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.597425 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.597583 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.597741 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.597891 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.598119 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.598284 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.598433 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.598590 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.598749 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.598908 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.599067 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.599216 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.599372 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.599522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.599678 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.599842 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.599842 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.600219 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.600508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.600662 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.600822 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.600981 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.601425 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.601696 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.601853 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.602014 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.602164 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.602322 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.602591 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.602746 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.602923 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.603078 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.603228 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.603387 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.603538 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.603687 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.603837 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.603837 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.604155 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.604311 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.604478 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.604628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.604777 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.604936 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.605371 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.606220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.606411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.606643 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.606903 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.607157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.607343 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.607495 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.607644 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.607793 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.607942 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.608158 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.608377 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.608539 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.608698 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.615063 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.615363 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.615557 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.615753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.615913 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.616067 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.616306 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.616461 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.616631 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.616830 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.616988 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.617146 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.617297 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.617447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.617619 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.617777 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.617928 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.618078 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.618234 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.618398 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.618549 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.618719 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.618870 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.619027 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.619184 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.619347 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.619497 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.619655 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.619814 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.619973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.622856 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.623087 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.623261 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.623437 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.623593 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.623752 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.623916 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.624079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.624288 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.624288 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.624288 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.624722 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.624882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.625079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.625234 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.625396 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.625545 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.625704 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.625863 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.626022 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.626173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.626933 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.627093 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.627253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.627412 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.627563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.627783 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.627942 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.628122 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.628281 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.628431 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.628592 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.628755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.628989 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.629154 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.629372 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.629542 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.629732 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.629895 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.630067 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.630067 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.630402 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.630561 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.630725 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.630877 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.631027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.631176 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.631176 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.631477 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.631639 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.631796 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.631945 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.632133 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.632304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.632469 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.632625 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.632776 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.632931 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.633081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.633237 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.633402 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.633559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.633709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.633865 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.634037 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.634193 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.634356 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.634356 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.634655 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.634811 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.634968 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.635131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.635280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.635430 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.635585 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.635735 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.635884 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.635884 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.636230 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.639268 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.639514 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.639923 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.640121 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.640306 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.640465 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.640617 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.640779 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.640930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.641081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.641241 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.641445 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.641606 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.641760 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.641918 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.642153 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.642313 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.642469 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.642618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.642778 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.643052 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.643229 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.643382 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.643569 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.643569 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.643891 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.644052 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.644251 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.644405 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.644564 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.644722 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.644881 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.645045 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.645204 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.645507 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.645663 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.645828 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.645980 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.646139 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.646560 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.646772 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.648331 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.648512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.648665 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.648816 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.648914 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.648992 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.649092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.649261 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.649410 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.649575 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.649575 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.649575 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.649964 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.650121 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.650323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.650479 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.650644 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.650812 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.650979 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.651134 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.651306 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.651461 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.651626 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.651775 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.651924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.652137 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.652310 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.652490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.652688 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.652853 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.653004 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.653168 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.653340 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 08:54:48.653528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.653528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.653528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.653528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.653528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.653528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.653528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.653528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.654676 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.654676 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.654676 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.654676 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.654676 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.654676 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.654676 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.654676 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.655801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.655801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.655801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.655801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.655801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.655801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.655801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.655801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.658509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.658509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.658509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.658509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.658509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.658509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.658509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.658509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.659629 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.659629 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.659629 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.659629 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.659629 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.659629 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.659629 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.659629 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.660807 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.660807 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.660807 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.660807 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.660807 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.660807 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.660807 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.660807 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.661882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.661882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.661882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.661882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.661882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.661882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.661882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.661882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.663413 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.663413 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.663413 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.663413 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.663413 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.663413 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.663413 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.663413 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.665709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.665709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.665709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.665709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.665709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.665709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.665709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.665709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.667125 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.667125 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.667125 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.667125 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.667125 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.667125 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.667125 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.667125 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.669167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.669167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.669167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.669167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.669167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.669167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.669167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.669167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.670462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.670462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.670462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.670462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.670462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.670462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.670462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.670462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.671605 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.671605 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.671605 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.671605 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.671605 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.671605 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.671605 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.671605 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.672787 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.672787 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.672787 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.672787 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.672787 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.672787 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.672787 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.672787 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.674124 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.674124 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.674124 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.674124 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.674124 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.674124 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.674124 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.674124 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.675979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.675979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.675979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.675979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.675979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.675979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.675979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.675979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.676928 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.676928 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.676928 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.676928 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.676928 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:54:48.676928 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 08:54:48.694560 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO dbcounter [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] Registered counter for database nova_api Aug 24 08:54:48.719229 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_db.sqlalchemy.engines [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:54:48.728470 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writer thread running {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:54:48.733401 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO dbcounter [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] Registered counter for database nova_api Aug 24 08:54:48.755091 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_db.sqlalchemy.engines [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:54:48.763166 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writer thread running {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:54:48.804164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.context [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),494397f8-d04d-4a37-97c3-122ec902df53(cell1) {{(pid=120542) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 08:54:48.808500 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:54:48.809043 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:54:48.810765 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:54:48.811583 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:54:48.812175 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:54:48.814278 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:54:48.816789 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO dbcounter [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] Registered counter for database nova_cell0 Aug 24 08:54:48.821343 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO dbcounter [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] Registered counter for database nova_cell1 Aug 24 08:54:48.823668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.context [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),494397f8-d04d-4a37-97c3-122ec902df53(cell1) {{(pid=120543) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 08:54:48.830736 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_db.sqlalchemy.engines [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:54:48.832150 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_db.sqlalchemy.engines [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:54:48.832348 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:54:48.833216 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:54:48.836522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:54:48.837894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:54:48.838748 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:54:48.839039 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writer thread running {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:54:48.841062 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writer thread running {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:54:48.842628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:54:48.844820 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO dbcounter [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] Registered counter for database nova_cell0 Aug 24 08:54:48.849215 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO dbcounter [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] Registered counter for database nova_cell1 Aug 24 08:54:48.858775 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_db.sqlalchemy.engines [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:54:48.863520 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_db.sqlalchemy.engines [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:54:48.865155 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writer thread running {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:54:48.997765 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO dbcounter [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] Registered counter for database nova_cell0 Aug 24 08:54:49.005903 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_db.sqlalchemy.engines [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:54:49.011989 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writer thread running {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:54:49.016236 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writer thread running {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:54:49.028405 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO dbcounter [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] Registered counter for database nova_cell0 Aug 24 08:54:49.040711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_db.sqlalchemy.engines [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:54:49.046983 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writer thread running {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:54:49.359013 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: WARNING keystonemiddleware.auth_token [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 08:54:49.367478 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: WARNING keystonemiddleware.auth_token [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 08:54:49.383944 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: WARNING keystonemiddleware.auth_token [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 08:54:49.392197 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: WARNING keystonemiddleware.auth_token [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 08:54:49.722756 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: WARNING keystonemiddleware.auth_token [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 08:54:49.730401 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: WARNING keystonemiddleware.auth_token [None req-d1cd6694-bfaf-4999-9da0-96aa0b3b9f54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 08:54:49.736211 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563cd741c9c0 pid: 120542 (default app) Aug 24 08:54:49.775580 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: WARNING keystonemiddleware.auth_token [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 08:54:49.781860 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: WARNING keystonemiddleware.auth_token [None req-fc0f7cec-7dcf-468d-bd9e-f847186e0c68 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 08:54:49.787199 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563cd741c9c0 pid: 120543 (default app) Aug 24 08:55:26.172177 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:26.173734 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:26.174659 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:26.175394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:27.452730 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f2d4742d-ebe2-404c-8443-efecb2601d2c tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] Action: 'create', calling method: .version_select at 0x7fb142de55e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-451163979", "metadata": {"Type": "work"}}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:27.699797 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:27.704316 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:27.705368 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:27.706088 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:28.937119 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dc16e643-f8a2-4f18-b7be-d1963d83a0c2 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Action: 'create', calling method: .version_select at 0x7fb142de65e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1781045169"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:29.692368 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f2d4742d-ebe2-404c-8443-efecb2601d2c tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.528133 Aug 24 08:55:29.693000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 1/1] 10.222.0.67 () {60 vars in 1156 bytes} [Wed Aug 24 08:55:26 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3531 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 08:55:29.712434 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-09052a89-5088-4a73-bb7f-752fa824447d tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] Calling method '.version_select at 0x7fb142cbb4c0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:29.830078 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-09052a89-5088-4a73-bb7f-752fa824447d tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/5061ba5b-18e9-4eca-b135-3125c5c433fb" status: 200 len: 352 microversion: 2.1 time: 0.125714 Aug 24 08:55:29.830639 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 2/2] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 24 08:55:29 2022] GET /compute/v2.1/os-volumes/5061ba5b-18e9-4eca-b135-3125c5c433fb => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:30.623787 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dc16e643-f8a2-4f18-b7be-d1963d83a0c2 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.931373 Aug 24 08:55:30.633842 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 1/3] 10.222.0.67 () {60 vars in 1155 bytes} [Wed Aug 24 08:55:27 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2936 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 08:55:30.638991 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0962c77d-5b74-4425-9c4a-64dbea461c0a tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142cbbb80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:30.744042 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0962c77d-5b74-4425-9c4a-64dbea461c0a tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786" status: 200 len: 345 microversion: 2.1 time: 0.108748 Aug 24 08:55:30.750260 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 3/4] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 24 08:55:30 2022] GET /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786 => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:30.864814 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a7b2eeff-0ec9-42b5-b84b-85e6203c849d tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] Calling method '.version_select at 0x7fb142cb94c0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:31.023718 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a7b2eeff-0ec9-42b5-b84b-85e6203c849d tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/5061ba5b-18e9-4eca-b135-3125c5c433fb" status: 200 len: 352 microversion: 2.1 time: 0.182529 Aug 24 08:55:31.024322 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 2/5] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 24 08:55:30 2022] GET /compute/v2.1/os-volumes/5061ba5b-18e9-4eca-b135-3125c5c433fb => generated 352 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:31.759558 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-24df416a-989b-4147-8f20-e8695c132b34 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142cd3310>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:31.989210 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-24df416a-989b-4147-8f20-e8695c132b34 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786" status: 200 len: 346 microversion: 2.1 time: 0.235003 Aug 24 08:55:31.996950 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 4/6] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 24 08:55:31 2022] GET /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786 => generated 346 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:32.004367 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9d359490-5c27-45c3-a4bc-4bb94a0cc41e tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Action: 'create', calling method: .version_select at 0x7fb142cb9b80>, body: {"snapshot": {"volume_id": "99d46098-7643-4b17-a7c0-22bb372f3786", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-43051956"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:32.039151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3a18a6c9-8905-4424-8c05-f54a3833e3ad tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] Calling method '.version_select at 0x7fb142cbbb80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:32.176956 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3a18a6c9-8905-4424-8c05-f54a3833e3ad tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/5061ba5b-18e9-4eca-b135-3125c5c433fb" status: 200 len: 353 microversion: 2.1 time: 0.140949 Aug 24 08:55:32.178455 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 5/7] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 24 08:55:32 2022] GET /compute/v2.1/os-volumes/5061ba5b-18e9-4eca-b135-3125c5c433fb => generated 353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:32.192374 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3bacfbe9-2d63-4de0-b22e-6315bd916500 tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] Calling method '.version_select at 0x7fb142cbb4c0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:32.273551 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3bacfbe9-2d63-4de0-b22e-6315bd916500 tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/5061ba5b-18e9-4eca-b135-3125c5c433fb" status: 200 len: 353 microversion: 2.1 time: 0.086058 Aug 24 08:55:32.274611 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 6/8] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 24 08:55:32 2022] GET /compute/v2.1/os-volumes/5061ba5b-18e9-4eca-b135-3125c5c433fb => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:32.288695 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8ee6b896-46fc-4fd6-90c0-1c9cfbdec596 tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] Calling method '.version_select at 0x7fb142cd3550>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:32.439688 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8ee6b896-46fc-4fd6-90c0-1c9cfbdec596 tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/5061ba5b-18e9-4eca-b135-3125c5c433fb" status: 202 len: 0 microversion: 2.1 time: 0.154668 Aug 24 08:55:32.440415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 7/9] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 24 08:55:32 2022] DELETE /compute/v2.1/os-volumes/5061ba5b-18e9-4eca-b135-3125c5c433fb => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 08:55:32.448620 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-10102821-53da-44a8-afce-326482a93cb7 tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] Calling method '.version_select at 0x7fb142cbb280>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:32.549829 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9d359490-5c27-45c3-a4bc-4bb94a0cc41e tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.550132 Aug 24 08:55:32.550505 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 3/10] 10.222.0.67 () {60 vars in 1162 bytes} [Wed Aug 24 08:55:31 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:32.559366 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-10102821-53da-44a8-afce-326482a93cb7 tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/5061ba5b-18e9-4eca-b135-3125c5c433fb" status: 200 len: 352 microversion: 2.1 time: 0.114355 Aug 24 08:55:32.560483 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 8/11] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 24 08:55:32 2022] GET /compute/v2.1/os-volumes/5061ba5b-18e9-4eca-b135-3125c5c433fb => generated 352 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:32.562992 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8193786d-5f79-44ec-8ae3-ea5b7a1073a2 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142cd0ca0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:32.617904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8193786d-5f79-44ec-8ae3-ea5b7a1073a2 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d" status: 200 len: 285 microversion: 2.1 time: 0.060502 Aug 24 08:55:32.619035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 4/12] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 24 08:55:32 2022] GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d => generated 285 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:55:32.631138 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4a1a3d01-a5ba-4b6e-9667-763e0cbc08d0 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142cbb940>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:32.705746 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4a1a3d01-a5ba-4b6e-9667-763e0cbc08d0 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.079040 Aug 24 08:55:32.706807 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 9/13] 10.222.0.67 () {58 vars in 1140 bytes} [Wed Aug 24 08:55:32 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:32.723718 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a4b28c1b-1e20-4353-80f8-98ac4ec49cde tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142cd0700>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:32.798347 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a4b28c1b-1e20-4353-80f8-98ac4ec49cde tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d" status: 200 len: 285 microversion: 2.1 time: 0.084038 Aug 24 08:55:32.799169 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 5/14] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 24 08:55:32 2022] GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d => generated 285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:55:33.580561 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-71cf95ad-c2f8-4e34-a1f3-e532a132f228 tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] Calling method '.version_select at 0x7fb142cd3dc0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:33.655630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-71cf95ad-c2f8-4e34-a1f3-e532a132f228 tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] HTTP exception thrown: Volume 5061ba5b-18e9-4eca-b135-3125c5c433fb could not be found. Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-71cf95ad-c2f8-4e34-a1f3-e532a132f228 tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] Request method failure captured: Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/os-volumes/5061ba5b-18e9-4eca-b135-3125c5c433fb HTTP/1.1 Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBed-WHfDLUOCXLWFb8ON_-WxozS25OzXOBMKq4TZDzsimcJq23_c6PUNI1QJy0hb2ZRXT_fhSTke0vxFReTEn_b0EHfeW3bmcUT_nYKH6nF-FEWpqpjQ9OT8RuyC3GqzmZ3Jz-NRBew4DgTH3ytZ627mRGnpANPAS3LInLPEw4iFJ7Y Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: dba44ee9cc0c427a81b9c539b056e30d Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-VolumesGetTestJSON-234453615 Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 08:55:33.661839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 08:55:33.663545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_dba44ee9cc0c427a81b9c539b056e30d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/dba44ee9cc0c427a81b9c539b056e30d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dba44ee9cc0c427a81b9c539b056e30d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/dba44ee9cc0c427a81b9c539b056e30d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:55:33.663545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-VolumesGetTestJSON-234453615 Aug 24 08:55:33.663545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: dba44ee9cc0c427a81b9c539b056e30d Aug 24 08:55:33.663545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-VolumesGetTestJSON-234453615 Aug 24 08:55:33.663545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-VolumesGetTestJSON-234453615-project Aug 24 08:55:33.663545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 08:55:33.663545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 08:55:33.663545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: e84cbb1c1968413989870678d1165d17 Aug 24 08:55:33.663545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-VolumesGetTestJSON-234453615-project Aug 24 08:55:33.663545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: Aug 24 08:55:33.663545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Volume 5061ba5b-18e9-4eca-b135-3125c5c433fb could not be found. Aug 24 08:55:33.663545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '5061ba5b-18e9-4eca-b135-3125c5c433fb'} Aug 24 08:55:33.663545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5061ba5b-18e9-4eca-b135-3125c5c433fb could not be found. (HTTP 404) (Request-ID: req-d90cc973-b638-4418-b32a-04539b1a2fe7) Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:33.664697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 08:55:33.665858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5061ba5b-18e9-4eca-b135-3125c5c433fb could not be found. Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 08:55:33.667559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:55:33.668571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5061ba5b-18e9-4eca-b135-3125c5c433fb could not be found. Aug 24 08:55:33.668571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:33.668571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:33.668571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:33.668571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:33.668571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:33.668571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:33.668571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:55:33.668571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:55:33.668571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5061ba5b-18e9-4eca-b135-3125c5c433fb could not be found. Aug 24 08:55:33.668571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:33.670399 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-71cf95ad-c2f8-4e34-a1f3-e532a132f228 tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] Returning 404 to user: Volume 5061ba5b-18e9-4eca-b135-3125c5c433fb could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:33.673527 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-71cf95ad-c2f8-4e34-a1f3-e532a132f228 tempest-VolumesGetTestJSON-234453615 tempest-VolumesGetTestJSON-234453615-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/5061ba5b-18e9-4eca-b135-3125c5c433fb" status: 404 len: 109 microversion: 2.1 time: 0.103181 Aug 24 08:55:33.680398 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 10/15] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 24 08:55:33 2022] GET /compute/v2.1/os-volumes/5061ba5b-18e9-4eca-b135-3125c5c433fb => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:55:33.811036 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bffcd62c-649c-48de-9ec0-2aee9d8a3031 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb143693820>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:33.946779 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bffcd62c-649c-48de-9ec0-2aee9d8a3031 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d" status: 200 len: 285 microversion: 2.1 time: 0.139428 Aug 24 08:55:33.947338 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 6/16] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 24 08:55:33 2022] GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:34.959757 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c2820e76-5c02-4c7e-982a-2a6d43457b76 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142cbb430>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:35.035554 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c2820e76-5c02-4c7e-982a-2a6d43457b76 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d" status: 200 len: 285 microversion: 2.1 time: 0.079708 Aug 24 08:55:35.036449 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 11/17] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 24 08:55:34 2022] GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d => generated 285 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:36.050811 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-944c014f-b48b-4dac-beaa-40da30090707 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142cb9ca0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:36.273058 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-944c014f-b48b-4dac-beaa-40da30090707 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d" status: 200 len: 285 microversion: 2.1 time: 0.228425 Aug 24 08:55:36.273481 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 7/18] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 24 08:55:36 2022] GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d => generated 285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:37.287039 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4cc9fa38-09fc-4296-8f74-edd6eb983046 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142cbbe50>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:37.336825 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4cc9fa38-09fc-4296-8f74-edd6eb983046 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d" status: 200 len: 285 microversion: 2.1 time: 0.053851 Aug 24 08:55:37.337857 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 12/19] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 24 08:55:37 2022] GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d => generated 285 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:38.350614 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ac5af70f-2e59-40c4-b6d8-f864116a3e6f tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142cb9550>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:38.399589 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ac5af70f-2e59-40c4-b6d8-f864116a3e6f tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d" status: 200 len: 285 microversion: 2.1 time: 0.052675 Aug 24 08:55:38.401816 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 8/20] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 24 08:55:38 2022] GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d => generated 285 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:39.414544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bb6f21e1-8a31-4d61-a009-9a513eafd3ab tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142cd3d30>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:39.478753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bb6f21e1-8a31-4d61-a009-9a513eafd3ab tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d" status: 200 len: 286 microversion: 2.1 time: 0.068638 Aug 24 08:55:39.480313 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 13/21] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 24 08:55:39 2022] GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:39.491593 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c7be3105-0fc6-4612-9f44-d2fa2e804fc8 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142cb9d30>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:39.587773 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c7be3105-0fc6-4612-9f44-d2fa2e804fc8 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "DELETE /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d" status: 202 len: 0 microversion: 2.1 time: 0.100199 Aug 24 08:55:39.588484 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 9/22] 10.222.0.67 () {58 vars in 1254 bytes} [Wed Aug 24 08:55:39 2022] DELETE /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:55:39.600195 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bb0a58a8-0844-445a-bcad-1e6fb5397b97 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142c40670>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:39.661374 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bb0a58a8-0844-445a-bcad-1e6fb5397b97 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d" status: 200 len: 285 microversion: 2.1 time: 0.067541 Aug 24 08:55:39.662283 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 14/23] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 24 08:55:39 2022] GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d => generated 285 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:40.203871 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bccfef82-b96b-43d5-bd1c-4596fcfb76c6 tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] Calling method '.version_select at 0x7fb142c40d30>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:40.301843 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1a990241-0d9f-4f80-b866-578b37b59771 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Action: 'create', calling method: .version_select at 0x7fb143693b80>, body: {"keypair": {"name": "tempest-keypair-1489975535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWtMIRZXaxn7ZYr55brzyppEUcMWPB4d+hb23zS8NMIGJkpy8SRRv+qkKAlTTXc0WFUN58JRzxGln4hy+YZLNWL7wQGmIbZ+nHuVUWdqB8TK0RqJa1jUa8h+mUgegP+qQ=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:40.405938 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bccfef82-b96b-43d5-bd1c-4596fcfb76c6 tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/6a6f6637-017b-41a5-b4ef-02f295965e67" status: 200 len: 350 microversion: 2.1 time: 0.209820 Aug 24 08:55:40.406859 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 15/24] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 24 08:55:40 2022] GET /compute/v2.1/os-volumes/6a6f6637-017b-41a5-b4ef-02f295965e67 => generated 350 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:40.524895 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-1a990241-0d9f-4f80-b866-578b37b59771 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Getting quotas for project bd6e1733fd9d4f5096c35e99dd56945b. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:55:40.553012 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-1a990241-0d9f-4f80-b866-578b37b59771 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Getting quotas for user f0dc2dcc5327489c9ecc28a43ab7c0e2 and project bd6e1733fd9d4f5096c35e99dd56945b. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:55:40.678030 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-642916bb-2295-4028-a50a-ff428fce014e tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142c40b80>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:40.713636 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1a990241-0d9f-4f80-b866-578b37b59771 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.574083 Aug 24 08:55:40.722952 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 10/25] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 24 08:55:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:55:40.744038 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-642916bb-2295-4028-a50a-ff428fce014e tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] HTTP exception thrown: Snapshot 694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d could not be found. Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-642916bb-2295-4028-a50a-ff428fce014e tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Request method failure captured: Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d HTTP/1.1 Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBed_rScZTAMT9cjIZASFfNtlm2ofiJWYoJZo5EiDqVU18G2b8t2G-dzJtS1UjguVImYxvEmHd3Hw5IzR2XWQE8Jv1k19Vew0QBOav5Vk0EZTh0a7dQGR4hmhHWIr7DLbUrjhit6qE4lpKtchJj2xtqn9cmqjpJIYl6MwSeoiIFHIuDg Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: a586b9a96c934f9db30983d83142208f Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2115724547 Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 08:55:40.748028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 08:55:40.749557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a586b9a96c934f9db30983d83142208f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a586b9a96c934f9db30983d83142208f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a586b9a96c934f9db30983d83142208f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a586b9a96c934f9db30983d83142208f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:55:40.749557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2115724547 Aug 24 08:55:40.749557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: a586b9a96c934f9db30983d83142208f Aug 24 08:55:40.749557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2115724547 Aug 24 08:55:40.749557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-VolumesSnapshotsTestJSON-2115724547-project Aug 24 08:55:40.749557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 08:55:40.749557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 08:55:40.749557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: db10227415804c2287ec4a60a6cbd2d5 Aug 24 08:55:40.749557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2115724547-project Aug 24 08:55:40.749557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: Aug 24 08:55:40.749557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Snapshot 694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d could not be found. Aug 24 08:55:40.749557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d'} Aug 24 08:55:40.749557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d could not be found. (HTTP 404) (Request-ID: req-09d77881-83d6-4ea6-ac0d-9e430969c4e7) Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:40.750321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 08:55:40.751338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d could not be found. Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 08:55:40.752415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:55:40.753589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d could not be found. Aug 24 08:55:40.753589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:40.753589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:40.753589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:40.753589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:40.753589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:40.753589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:40.753589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:55:40.753589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:55:40.753589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d could not be found. Aug 24 08:55:40.753589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:40.755405 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-642916bb-2295-4028-a50a-ff428fce014e tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Returning 404 to user: Snapshot 694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:40.756475 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-642916bb-2295-4028-a50a-ff428fce014e tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d" status: 404 len: 111 microversion: 2.1 time: 0.082798 Aug 24 08:55:40.757213 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 16/26] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 24 08:55:40 2022] GET /compute/v2.1/os-snapshots/694b78cc-0bf5-4e6f-a2f8-92c5f7f8ad4d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 08:55:40.775166 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ffae6e0e-5ee4-40bb-8be3-63fe4188b940 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142c2daf0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:40.998440 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ffae6e0e-5ee4-40bb-8be3-63fe4188b940 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786" status: 202 len: 0 microversion: 2.1 time: 0.235921 Aug 24 08:55:41.000043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 11/27] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 24 08:55:40 2022] DELETE /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:55:41.007991 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8ceb8bf8-9eb0-4bc8-b53c-3a5c1fcb528a tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142cbbf70>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:41.156558 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8ceb8bf8-9eb0-4bc8-b53c-3a5c1fcb528a tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786" status: 200 len: 345 microversion: 2.1 time: 0.152344 Aug 24 08:55:41.158587 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 17/28] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 24 08:55:41 2022] GET /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786 => generated 345 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:42.172393 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ef09eb21-49ff-4def-a8b2-08a24170da69 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142c61160>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:42.222181 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-ef09eb21-49ff-4def-a8b2-08a24170da69 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] HTTP exception thrown: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ef09eb21-49ff-4def-a8b2-08a24170da69 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Request method failure captured: Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: GET /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786 HTTP/1.1 Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBed_rScZTAMT9cjIZASFfNtlm2ofiJWYoJZo5EiDqVU18G2b8t2G-dzJtS1UjguVImYxvEmHd3Hw5IzR2XWQE8Jv1k19Vew0QBOav5Vk0EZTh0a7dQGR4hmhHWIr7DLbUrjhit6qE4lpKtchJj2xtqn9cmqjpJIYl6MwSeoiIFHIuDg Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: a586b9a96c934f9db30983d83142208f Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2115724547 Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 08:55:42.227237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 08:55:42.228641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a586b9a96c934f9db30983d83142208f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a586b9a96c934f9db30983d83142208f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a586b9a96c934f9db30983d83142208f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a586b9a96c934f9db30983d83142208f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:55:42.228641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2115724547 Aug 24 08:55:42.228641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: a586b9a96c934f9db30983d83142208f Aug 24 08:55:42.228641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2115724547 Aug 24 08:55:42.228641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-VolumesSnapshotsTestJSON-2115724547-project Aug 24 08:55:42.228641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 08:55:42.228641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 08:55:42.228641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: db10227415804c2287ec4a60a6cbd2d5 Aug 24 08:55:42.228641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2115724547-project Aug 24 08:55:42.228641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: Aug 24 08:55:42.228641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. Aug 24 08:55:42.228641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': '99d46098-7643-4b17-a7c0-22bb372f3786'} Aug 24 08:55:42.228641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. (HTTP 404) (Request-ID: req-c3075498-bc8b-4cdb-9058-a1ab2624e562) Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:42.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 08:55:42.230239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 08:55:42.231131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:55:42.232043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. Aug 24 08:55:42.232043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.232043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:42.232043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.232043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:42.232043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:42.232043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:42.232043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:55:42.232043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:55:42.232043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. Aug 24 08:55:42.232043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.233502 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ef09eb21-49ff-4def-a8b2-08a24170da69 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Returning 404 to user: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:42.237120 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ef09eb21-49ff-4def-a8b2-08a24170da69 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786" status: 404 len: 109 microversion: 2.1 time: 0.069180 Aug 24 08:55:42.248324 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 12/29] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 24 08:55:42 2022] GET /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:55:42.279945 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-379797c3-a387-4558-aa56-f8d80a286776 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142c400d0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:42.364575 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-379797c3-a387-4558-aa56-f8d80a286776 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] HTTP exception thrown: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-379797c3-a387-4558-aa56-f8d80a286776 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Request method failure captured: Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: DELETE /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786 HTTP/1.1 Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBed_rScZTAMT9cjIZASFfNtlm2ofiJWYoJZo5EiDqVU18G2b8t2G-dzJtS1UjguVImYxvEmHd3Hw5IzR2XWQE8Jv1k19Vew0QBOav5Vk0EZTh0a7dQGR4hmhHWIr7DLbUrjhit6qE4lpKtchJj2xtqn9cmqjpJIYl6MwSeoiIFHIuDg Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: a586b9a96c934f9db30983d83142208f Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2115724547 Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 08:55:42.366618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 08:55:42.367654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a586b9a96c934f9db30983d83142208f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a586b9a96c934f9db30983d83142208f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a586b9a96c934f9db30983d83142208f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a586b9a96c934f9db30983d83142208f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:55:42.367654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2115724547 Aug 24 08:55:42.367654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: a586b9a96c934f9db30983d83142208f Aug 24 08:55:42.367654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2115724547 Aug 24 08:55:42.367654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-VolumesSnapshotsTestJSON-2115724547-project Aug 24 08:55:42.367654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 08:55:42.367654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 08:55:42.367654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: db10227415804c2287ec4a60a6cbd2d5 Aug 24 08:55:42.367654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2115724547-project Aug 24 08:55:42.367654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: Aug 24 08:55:42.367654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. Aug 24 08:55:42.367654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '99d46098-7643-4b17-a7c0-22bb372f3786'} Aug 24 08:55:42.367654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. (HTTP 404) (Request-ID: req-55636cf4-97fb-4f23-b9a9-c42817768a07) Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:42.368319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 08:55:42.369185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 08:55:42.370369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:55:42.371495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. Aug 24 08:55:42.371495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.371495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:42.371495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.371495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:42.371495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:42.371495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:42.371495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:55:42.371495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:55:42.371495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. Aug 24 08:55:42.371495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.371495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-379797c3-a387-4558-aa56-f8d80a286776 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Returning 404 to user: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:42.371495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-379797c3-a387-4558-aa56-f8d80a286776 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786" status: 404 len: 109 microversion: 2.1 time: 0.115671 Aug 24 08:55:42.377393 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 18/30] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 24 08:55:42 2022] DELETE /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786 => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:55:42.386822 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7c9006ee-ced9-4fc2-8c1b-200d903bc885 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Calling method '.version_select at 0x7fb142c61f70>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:42.442467 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f1b95f5a-cf9b-4bbc-85b4-a32dcf8477e5 tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] Calling method '.version_select at 0x7fb142cbb790>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:42.453150 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-7c9006ee-ced9-4fc2-8c1b-200d903bc885 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] HTTP exception thrown: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7c9006ee-ced9-4fc2-8c1b-200d903bc885 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Request method failure captured: Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: GET /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786 HTTP/1.1 Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBed_rScZTAMT9cjIZASFfNtlm2ofiJWYoJZo5EiDqVU18G2b8t2G-dzJtS1UjguVImYxvEmHd3Hw5IzR2XWQE8Jv1k19Vew0QBOav5Vk0EZTh0a7dQGR4hmhHWIr7DLbUrjhit6qE4lpKtchJj2xtqn9cmqjpJIYl6MwSeoiIFHIuDg Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: a586b9a96c934f9db30983d83142208f Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2115724547 Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 08:55:42.456187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 08:55:42.457450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a586b9a96c934f9db30983d83142208f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a586b9a96c934f9db30983d83142208f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a586b9a96c934f9db30983d83142208f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a586b9a96c934f9db30983d83142208f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:55:42.457450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2115724547 Aug 24 08:55:42.457450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: a586b9a96c934f9db30983d83142208f Aug 24 08:55:42.457450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2115724547 Aug 24 08:55:42.457450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-VolumesSnapshotsTestJSON-2115724547-project Aug 24 08:55:42.457450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 08:55:42.457450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 08:55:42.457450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: db10227415804c2287ec4a60a6cbd2d5 Aug 24 08:55:42.457450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2115724547-project Aug 24 08:55:42.457450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: Aug 24 08:55:42.457450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. Aug 24 08:55:42.457450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': '99d46098-7643-4b17-a7c0-22bb372f3786'} Aug 24 08:55:42.457450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. (HTTP 404) (Request-ID: req-318b7b73-c7f2-4b57-954e-40e46f439522) Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:42.458174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 08:55:42.459067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 08:55:42.462485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:55:42.466750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. Aug 24 08:55:42.466750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.466750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:42.466750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.466750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:42.466750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:42.466750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:42.466750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:55:42.466750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:55:42.466750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. Aug 24 08:55:42.466750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:42.474860 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7c9006ee-ced9-4fc2-8c1b-200d903bc885 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] Returning 404 to user: Volume 99d46098-7643-4b17-a7c0-22bb372f3786 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:42.482352 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7c9006ee-ced9-4fc2-8c1b-200d903bc885 tempest-VolumesSnapshotsTestJSON-2115724547 tempest-VolumesSnapshotsTestJSON-2115724547-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786" status: 404 len: 109 microversion: 2.1 time: 0.104831 Aug 24 08:55:42.484430 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 13/31] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 24 08:55:42 2022] GET /compute/v2.1/os-volumes/99d46098-7643-4b17-a7c0-22bb372f3786 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:55:42.590517 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f1b95f5a-cf9b-4bbc-85b4-a32dcf8477e5 tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/6a7a7a6e-bb7e-4f6a-8bda-106228870629" status: 200 len: 350 microversion: 2.1 time: 0.162952 Aug 24 08:55:42.591875 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 19/32] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 24 08:55:42 2022] GET /compute/v2.1/os-volumes/6a7a7a6e-bb7e-4f6a-8bda-106228870629 => generated 350 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:44.512283 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dc1026f8-76ad-48dc-9e9e-14c4387cd574 tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] Calling method '.version_select at 0x7fb142c40ca0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:44.667513 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dc1026f8-76ad-48dc-9e9e-14c4387cd574 tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/10ca6cdb-58e1-43cc-bc3f-d5f41e6b27a4" status: 200 len: 351 microversion: 2.1 time: 0.171561 Aug 24 08:55:44.677587 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 20/33] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 24 08:55:44 2022] GET /compute/v2.1/os-volumes/10ca6cdb-58e1-43cc-bc3f-d5f41e6b27a4 => generated 351 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:44.683380 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b6e54b7d-0de5-4241-8f5a-b370303b7628 tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] Calling method '.version_select at 0x7fb142c403a0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:44.996713 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b6e54b7d-0de5-4241-8f5a-b370303b7628 tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.317415 Aug 24 08:55:44.998038 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 21/34] 10.222.0.67 () {58 vars in 1134 bytes} [Wed Aug 24 08:55:44 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:45.132558 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bded5e87-fe8f-423c-b1ee-487f673328fe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Action: 'create', calling method: .version_select at 0x7fb142c61b80>, body: {"keypair": {"name": "tempest-keypair-39258680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnGGtsr2YyDTzopR+A9mb6ZBy9oM3WU3UF9gh4RjAg/PJjJxdL3kr/8awkrWlzyIHMmWBEemkLCy8X4raTGrZXOd3cZxLY/UKNvHF8k4wcFTy3zr3kdPrxkE4Qc/0tQeQ=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:45.177019 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-bded5e87-fe8f-423c-b1ee-487f673328fe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Getting quotas for project edeca01476604a70bed160e5aa97607c. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:55:45.191135 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-bded5e87-fe8f-423c-b1ee-487f673328fe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Getting quotas for user f0d0eb9dc0f743c3985218901334b336 and project edeca01476604a70bed160e5aa97607c. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:55:45.242685 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2133871901", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:45.248652 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bded5e87-fe8f-423c-b1ee-487f673328fe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.945175 Aug 24 08:55:45.250082 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 14/35] 10.222.0.67 () {62 vars in 1200 bytes} [Wed Aug 24 08:55:44 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 948 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 08:55:45.267210 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4bf8046f-68e7-4b83-adbd-dec6e14a4a64 tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] Calling method '.version_select at 0x7fb1423d8310>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:45.560830 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4bf8046f-68e7-4b83-adbd-dec6e14a4a64 tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.301137 Aug 24 08:55:45.561420 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 15/36] 10.222.0.67 () {58 vars in 1149 bytes} [Wed Aug 24 08:55:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:45.580262 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-50154ded-a2d3-4cf2-bdb2-9a9b9e70b62b tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] Calling method '.version_select at 0x7fb1423dec10>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:45.624484 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] validate_networks() for [('c053db24-71f7-49c0-865c-6fe9c343616a', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:55:45.777588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-50154ded-a2d3-4cf2-bdb2-9a9b9e70b62b tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.201882 Aug 24 08:55:45.781424 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 16/37] 10.222.0.67 () {58 vars in 1134 bytes} [Wed Aug 24 08:55:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:45.799161 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d61c874a-69df-4cbe-bd09-2ef1c3a6a50a tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] Calling method '.version_select at 0x7fb1423de820>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:46.050530 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d61c874a-69df-4cbe-bd09-2ef1c3a6a50a tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.258559 Aug 24 08:55:46.053341 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 17/38] 10.222.0.67 () {58 vars in 1167 bytes} [Wed Aug 24 08:55:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:46.071147 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b5e3c7f0-07ea-4a47-85ce-e117f42d01fb tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] Calling method '.version_select at 0x7fb1423d8a60>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:46.245502 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b5e3c7f0-07ea-4a47-85ce-e117f42d01fb tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.180943 Aug 24 08:55:46.257325 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 18/39] 10.222.0.67 () {58 vars in 1170 bytes} [Wed Aug 24 08:55:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:46.262764 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f7487640-bcc2-4609-911b-d5657c09a4a1 tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] Calling method '.version_select at 0x7fb1423c71f0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:46.505239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f7487640-bcc2-4609-911b-d5657c09a4a1 tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.246439 Aug 24 08:55:46.505823 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 19/40] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 24 08:55:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:46.524062 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4a7ac847-985e-4c72-b368-c9a273ebfbb9 tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] Calling method '.version_select at 0x7fb1423d8550>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:46.688452 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4a7ac847-985e-4c72-b368-c9a273ebfbb9 tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.169890 Aug 24 08:55:46.689551 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 20/41] 10.222.0.67 () {58 vars in 1188 bytes} [Wed Aug 24 08:55:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:46.717438 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5b217758-b016-4143-9941-ba2af40a70c8 tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] Calling method '.version_select at 0x7fb1423de310>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:46.976776 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5b217758-b016-4143-9941-ba2af40a70c8 tempest-VolumesTestJSON-907335647 tempest-VolumesTestJSON-907335647-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.275450 Aug 24 08:55:46.977842 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 21/42] 10.222.0.67 () {58 vars in 1155 bytes} [Wed Aug 24 08:55:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:48.019467 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-03735d1a-8ace-42b2-a89d-764f35df55bd tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Action: 'create', calling method: .version_select at 0x7fb1423da790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-677009849", "metadata": {"Type": "work"}}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-03735d1a-8ace-42b2-a89d-764f35df55bd tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Request method failure captured: Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 121 Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeTf7Tz267AwfG9R_o0I05GqGGKC3JAkMusvsoKTZuhJPWlrLb6b6Ljyh-5JR4F_q86vH1ehIXxSZ0skxyQoVMX1CXBV-3BFSBicGL5AqG0NjbgfSfAcI3KuafHfnvxLmFieXbyy0IM7xKND-APZJEDnSYYsQ4M0-OMgPmzUHwdyFA Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 757709df42104f49916ed922429f2d80 Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 08:55:48.025998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 08:55:48.027220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_757709df42104f49916ed922429f2d80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/757709df42104f49916ed922429f2d80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/757709df42104f49916ed922429f2d80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/757709df42104f49916ed922429f2d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:55:48.027220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.027220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 757709df42104f49916ed922429f2d80 Aug 24 08:55:48.027220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.027220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-VolumesNegativeTest-1698530259-project Aug 24 08:55:48.027220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 08:55:48.027220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 08:55:48.027220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: 3e6b47f2407b43b68230f9572c108846 Aug 24 08:55:48.027220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-VolumesNegativeTest-1698530259-project Aug 24 08:55:48.027220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Aug 24 08:55:48.027220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-677009849", "metadata": {"Type": "work"}}} Aug 24 08:55:48.027220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: Aug 24 08:55:48.027220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-677009849', 'metadata': {'Type': 'work'}}}} Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:48.028203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 08:55:48.029328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 08:55:48.030211 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 08:55:48.030211 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.045131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-03735d1a-8ace-42b2-a89d-764f35df55bd tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:48.046970 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-03735d1a-8ace-42b2-a89d-764f35df55bd tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.528886 Aug 24 08:55:48.055973 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 22/43] 10.222.0.67 () {60 vars in 1156 bytes} [Wed Aug 24 08:55:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 535 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:55:48.073862 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-954c220a-1df8-4a43-9776-3dcc52e45f0c tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Action: 'create', calling method: .version_select at 0x7fb1423d8670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1535471556", "metadata": {"Type": "work"}}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-954c220a-1df8-4a43-9776-3dcc52e45f0c tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Request method failure captured: Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 120 Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeTf7Tz267AwfG9R_o0I05GqGGKC3JAkMusvsoKTZuhJPWlrLb6b6Ljyh-5JR4F_q86vH1ehIXxSZ0skxyQoVMX1CXBV-3BFSBicGL5AqG0NjbgfSfAcI3KuafHfnvxLmFieXbyy0IM7xKND-APZJEDnSYYsQ4M0-OMgPmzUHwdyFA Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 757709df42104f49916ed922429f2d80 Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 08:55:48.088522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 08:55:48.089915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_757709df42104f49916ed922429f2d80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/757709df42104f49916ed922429f2d80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/757709df42104f49916ed922429f2d80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/757709df42104f49916ed922429f2d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:55:48.089915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.089915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 757709df42104f49916ed922429f2d80 Aug 24 08:55:48.089915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.089915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-VolumesNegativeTest-1698530259-project Aug 24 08:55:48.089915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 08:55:48.089915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 08:55:48.089915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: 3e6b47f2407b43b68230f9572c108846 Aug 24 08:55:48.089915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-VolumesNegativeTest-1698530259-project Aug 24 08:55:48.089915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Aug 24 08:55:48.089915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1535471556", "metadata": {"Type": "work"}}} Aug 24 08:55:48.089915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: Aug 24 08:55:48.089915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1535471556', 'metadata': {'Type': 'work'}}}} Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi '0' Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:48.090694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 08:55:48.092027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 08:55:48.093621 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 08:55:48.093621 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.095018 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-954c220a-1df8-4a43-9776-3dcc52e45f0c tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:48.096664 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-954c220a-1df8-4a43-9776-3dcc52e45f0c tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.038712 Aug 24 08:55:48.097770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 23/44] 10.222.0.67 () {60 vars in 1156 bytes} [Wed Aug 24 08:55:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 08:55:48.117506 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-961204fe-84b1-4fea-8f16-14937ced4dcb tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Action: 'create', calling method: .version_select at 0x7fb1423da940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-174242180", "metadata": {"Type": "work"}}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-961204fe-84b1-4fea-8f16-14937ced4dcb tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Request method failure captured: Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 118 Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeTf7Tz267AwfG9R_o0I05GqGGKC3JAkMusvsoKTZuhJPWlrLb6b6Ljyh-5JR4F_q86vH1ehIXxSZ0skxyQoVMX1CXBV-3BFSBicGL5AqG0NjbgfSfAcI3KuafHfnvxLmFieXbyy0IM7xKND-APZJEDnSYYsQ4M0-OMgPmzUHwdyFA Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 757709df42104f49916ed922429f2d80 Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 08:55:48.130490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 08:55:48.132049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_757709df42104f49916ed922429f2d80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/757709df42104f49916ed922429f2d80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/757709df42104f49916ed922429f2d80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/757709df42104f49916ed922429f2d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:55:48.132049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.132049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 757709df42104f49916ed922429f2d80 Aug 24 08:55:48.132049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.132049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-VolumesNegativeTest-1698530259-project Aug 24 08:55:48.132049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 08:55:48.132049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 08:55:48.132049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: 3e6b47f2407b43b68230f9572c108846 Aug 24 08:55:48.132049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-VolumesNegativeTest-1698530259-project Aug 24 08:55:48.132049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Aug 24 08:55:48.132049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-174242180", "metadata": {"Type": "work"}}} Aug 24 08:55:48.132049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: Aug 24 08:55:48.132049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-174242180', 'metadata': {'Type': 'work'}}}} Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise error Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi '' Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:48.133000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 08:55:48.134777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 08:55:48.136016 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 08:55:48.136016 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.139312 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-961204fe-84b1-4fea-8f16-14937ced4dcb tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:48.142137 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-961204fe-84b1-4fea-8f16-14937ced4dcb tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.038886 Aug 24 08:55:48.144735 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 24/45] 10.222.0.67 () {60 vars in 1156 bytes} [Wed Aug 24 08:55:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 08:55:48.157122 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-22c350de-fbe9-4b01-806a-4b220e2653e2 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Calling method '.version_select at 0x7fb1423c7040>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:48.214826 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-22c350de-fbe9-4b01-806a-4b220e2653e2 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] HTTP exception thrown: Volume tempest-invalid-2133805265 could not be found. Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-22c350de-fbe9-4b01-806a-4b220e2653e2 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Request method failure captured: Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2133805265 HTTP/1.1 Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeTf7Tz267AwfG9R_o0I05GqGGKC3JAkMusvsoKTZuhJPWlrLb6b6Ljyh-5JR4F_q86vH1ehIXxSZ0skxyQoVMX1CXBV-3BFSBicGL5AqG0NjbgfSfAcI3KuafHfnvxLmFieXbyy0IM7xKND-APZJEDnSYYsQ4M0-OMgPmzUHwdyFA Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 757709df42104f49916ed922429f2d80 Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 08:55:48.216976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 08:55:48.218012 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_757709df42104f49916ed922429f2d80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/757709df42104f49916ed922429f2d80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/757709df42104f49916ed922429f2d80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/757709df42104f49916ed922429f2d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:55:48.218012 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.218012 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 757709df42104f49916ed922429f2d80 Aug 24 08:55:48.218012 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.218012 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-VolumesNegativeTest-1698530259-project Aug 24 08:55:48.218012 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 08:55:48.218012 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 08:55:48.218012 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: 3e6b47f2407b43b68230f9572c108846 Aug 24 08:55:48.218012 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-VolumesNegativeTest-1698530259-project Aug 24 08:55:48.218012 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: Aug 24 08:55:48.218012 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Volume tempest-invalid-2133805265 could not be found. Aug 24 08:55:48.218012 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': 'tempest-invalid-2133805265'} Aug 24 08:55:48.218012 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2133805265 could not be found. (HTTP 404) (Request-ID: req-ca247895-5cff-4396-a7ee-3e99a12273a0) Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:48.221800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 08:55:48.222770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2133805265 could not be found. Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:55:48.224536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2133805265 could not be found. Aug 24 08:55:48.225490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.225490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:48.225490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.225490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.225490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:48.225490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:48.225490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:55:48.225490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:55:48.225490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2133805265 could not be found. Aug 24 08:55:48.225490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.225490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-22c350de-fbe9-4b01-806a-4b220e2653e2 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Returning 404 to user: Volume tempest-invalid-2133805265 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:48.225490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-22c350de-fbe9-4b01-806a-4b220e2653e2 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2133805265" status: 404 len: 99 microversion: 2.1 time: 0.068513 Aug 24 08:55:48.225490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 25/46] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 24 08:55:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2133805265 => generated 99 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 08:55:48.229834 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b883afcd-bfc2-4265-89cc-abbf872c3410 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004386 Aug 24 08:55:48.230319 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 26/47] 10.222.0.67 () {58 vars in 1140 bytes} [Wed Aug 24 08:55:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 08:55:48.242778 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-259c2142-a516-495c-9635-acea8b711150 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005308 Aug 24 08:55:48.248031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 27/48] 10.222.0.67 () {58 vars in 1137 bytes} [Wed Aug 24 08:55:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 08:55:48.267590 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b54326eb-ca0b-4e26-8ef3-a635bbf2c7f3 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Calling method '.version_select at 0x7fb1423c74c0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:48.336185 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-b54326eb-ca0b-4e26-8ef3-a635bbf2c7f3 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] HTTP exception thrown: Volume 613d29f6-6010-4e75-b925-1927896a7bda could not be found. Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b54326eb-ca0b-4e26-8ef3-a635bbf2c7f3 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Request method failure captured: Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: DELETE /compute/v2.1/os-volumes/613d29f6-6010-4e75-b925-1927896a7bda HTTP/1.1 Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeTf7Tz267AwfG9R_o0I05GqGGKC3JAkMusvsoKTZuhJPWlrLb6b6Ljyh-5JR4F_q86vH1ehIXxSZ0skxyQoVMX1CXBV-3BFSBicGL5AqG0NjbgfSfAcI3KuafHfnvxLmFieXbyy0IM7xKND-APZJEDnSYYsQ4M0-OMgPmzUHwdyFA Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 757709df42104f49916ed922429f2d80 Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 08:55:48.338696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 08:55:48.340159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_757709df42104f49916ed922429f2d80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/757709df42104f49916ed922429f2d80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/757709df42104f49916ed922429f2d80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/757709df42104f49916ed922429f2d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:55:48.340159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.340159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 757709df42104f49916ed922429f2d80 Aug 24 08:55:48.340159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.340159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-VolumesNegativeTest-1698530259-project Aug 24 08:55:48.340159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 08:55:48.340159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 08:55:48.340159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: 3e6b47f2407b43b68230f9572c108846 Aug 24 08:55:48.340159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-VolumesNegativeTest-1698530259-project Aug 24 08:55:48.340159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: Aug 24 08:55:48.340159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Volume 613d29f6-6010-4e75-b925-1927896a7bda could not be found. Aug 24 08:55:48.340159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': '613d29f6-6010-4e75-b925-1927896a7bda'} Aug 24 08:55:48.340159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 613d29f6-6010-4e75-b925-1927896a7bda could not be found. (HTTP 404) (Request-ID: req-88967170-8945-40fc-b155-3e8cfe730391) Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:48.340943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 08:55:48.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 613d29f6-6010-4e75-b925-1927896a7bda could not be found. Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 08:55:48.343883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:55:48.346280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 613d29f6-6010-4e75-b925-1927896a7bda could not be found. Aug 24 08:55:48.346280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.346280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:48.346280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.346280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.346280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:48.346280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:48.346280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:55:48.346280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:55:48.346280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 613d29f6-6010-4e75-b925-1927896a7bda could not be found. Aug 24 08:55:48.346280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.350848 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b54326eb-ca0b-4e26-8ef3-a635bbf2c7f3 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Returning 404 to user: Volume 613d29f6-6010-4e75-b925-1927896a7bda could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:48.350848 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b54326eb-ca0b-4e26-8ef3-a635bbf2c7f3 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/613d29f6-6010-4e75-b925-1927896a7bda" status: 404 len: 109 microversion: 2.1 time: 0.090233 Aug 24 08:55:48.351643 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 28/49] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 24 08:55:48 2022] DELETE /compute/v2.1/os-volumes/613d29f6-6010-4e75-b925-1927896a7bda => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 08:55:48.362947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-991b1bbf-39bf-4dcc-8ce3-b1119cb53878 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Calling method '.version_select at 0x7fb1423d8310>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:48.426364 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-991b1bbf-39bf-4dcc-8ce3-b1119cb53878 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] HTTP exception thrown: Volume 94ca2be9-48f7-4de8-bd98-f4b924cfa391 could not be found. Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-991b1bbf-39bf-4dcc-8ce3-b1119cb53878 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Request method failure captured: Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: GET /compute/v2.1/os-volumes/94ca2be9-48f7-4de8-bd98-f4b924cfa391 HTTP/1.1 Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeTf7Tz267AwfG9R_o0I05GqGGKC3JAkMusvsoKTZuhJPWlrLb6b6Ljyh-5JR4F_q86vH1ehIXxSZ0skxyQoVMX1CXBV-3BFSBicGL5AqG0NjbgfSfAcI3KuafHfnvxLmFieXbyy0IM7xKND-APZJEDnSYYsQ4M0-OMgPmzUHwdyFA Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 757709df42104f49916ed922429f2d80 Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 08:55:48.429774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 08:55:48.431668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_757709df42104f49916ed922429f2d80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/757709df42104f49916ed922429f2d80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/757709df42104f49916ed922429f2d80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/757709df42104f49916ed922429f2d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:55:48.431668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.431668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 757709df42104f49916ed922429f2d80 Aug 24 08:55:48.431668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesNegativeTest-1698530259 Aug 24 08:55:48.431668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-VolumesNegativeTest-1698530259-project Aug 24 08:55:48.431668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 08:55:48.431668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 08:55:48.431668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: 3e6b47f2407b43b68230f9572c108846 Aug 24 08:55:48.431668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-VolumesNegativeTest-1698530259-project Aug 24 08:55:48.431668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: Aug 24 08:55:48.431668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Volume 94ca2be9-48f7-4de8-bd98-f4b924cfa391 could not be found. Aug 24 08:55:48.431668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': '94ca2be9-48f7-4de8-bd98-f4b924cfa391'} Aug 24 08:55:48.431668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94ca2be9-48f7-4de8-bd98-f4b924cfa391 could not be found. (HTTP 404) (Request-ID: req-73e03518-95aa-4a6d-bc15-8abc76a76c28) Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:48.432642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 08:55:48.434881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94ca2be9-48f7-4de8-bd98-f4b924cfa391 could not be found. Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 08:55:48.437167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:55:48.440742 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94ca2be9-48f7-4de8-bd98-f4b924cfa391 could not be found. Aug 24 08:55:48.440742 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.440742 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:55:48.440742 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.440742 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:55:48.440742 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:55:48.440742 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:55:48.440742 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:55:48.440742 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:55:48.440742 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94ca2be9-48f7-4de8-bd98-f4b924cfa391 could not be found. Aug 24 08:55:48.440742 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:55:48.444551 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-991b1bbf-39bf-4dcc-8ce3-b1119cb53878 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] Returning 404 to user: Volume 94ca2be9-48f7-4de8-bd98-f4b924cfa391 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:55:48.444974 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-991b1bbf-39bf-4dcc-8ce3-b1119cb53878 tempest-VolumesNegativeTest-1698530259 tempest-VolumesNegativeTest-1698530259-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/94ca2be9-48f7-4de8-bd98-f4b924cfa391" status: 404 len: 109 microversion: 2.1 time: 0.086870 Aug 24 08:55:48.446274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 29/50] 10.222.0.67 () {58 vars in 1245 bytes} [Wed Aug 24 08:55:48 2022] GET /compute/v2.1/os-volumes/94ca2be9-48f7-4de8-bd98-f4b924cfa391 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:55:48.867795 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1713193961", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452", "networks": [{"uuid": "43eaba81-e74a-4d9f-a8e9-d747b4d7d86d"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:49.207695 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] validate_networks() for [('43eaba81-e74a-4d9f-a8e9-d747b4d7d86d', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:55:50.788503 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:55:50.791659 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:55:50.792840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:55:50.797050 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:55:50.798210 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:55:50.855200 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:50.856088 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:50.856744 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:50.860519 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:50.863060 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:50.863848 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:50.929610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Getting quotas for project b5cb111df3ec4249a836518a598063a4. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:55:50.942930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Getting quotas for user 8ee5364270094596b64b08a8ac56f6ce and project b5cb111df3ec4249a836518a598063a4. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:55:50.982725 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:55:50.987310 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:55:51.126282 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d8c44a02-234c-48bf-ad17-07011b1ba239 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.126166 Aug 24 08:55:51.127133 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 22/51] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 08:55:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 6128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:55:51.139057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2094685452", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3230a42-b6ee-441d-accc-432f33a6ab3a"}], "security_groups": [{"name": "tempest-securitygroup--425626588"}], "key_name": "tempest-keypair-1489975535", "user_data": "}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:51.658334 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] validate_networks() for [('e3230a42-b6ee-441d-accc-432f33a6ab3a', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:55:52.103109 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:55:52.103674 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:55:52.104010 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:55:52.105247 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:55:52.109698 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:55:52.140448 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:52.141754 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:52.146215 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:52.147646 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:52.148683 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:52.150907 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:52.223350 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Getting quotas for project 39195166aed84c998b13b926c0a39ab7. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:55:52.233370 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Getting quotas for user 5c036cb4ba8e4a16bd9e884243e665c1 and project 39195166aed84c998b13b926c0a39ab7. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:55:52.267411 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:55:52.278382 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:55:52.505330 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9f4af0a0-2157-4400-ace9-290ac4efe0a6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.971364 Aug 24 08:55:52.507654 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 30/52] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 08:55:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 08:55:52.531305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1285549249", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aefdd75d-c13f-449c-a470-c3c20a8d011f"}], "security_groups": [{"name": "tempest-securitygroup--621557273"}], "key_name": "tempest-keypair-39258680", "user_data": "}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:53.158094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] validate_networks() for [('aefdd75d-c13f-449c-a470-c3c20a8d011f', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:55:53.427732 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:55:53.428661 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:55:53.429226 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:55:53.429814 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:55:53.430414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:55:53.467681 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:53.467681 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:53.470187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:53.476301 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:53.477165 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:53.480391 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:53.605144 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Getting quotas for project bd6e1733fd9d4f5096c35e99dd56945b. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:55:53.638252 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Getting quotas for user f0dc2dcc5327489c9ecc28a43ab7c0e2 and project bd6e1733fd9d4f5096c35e99dd56945b. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:55:53.713971 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:55:53.720464 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:55:54.066759 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-17f7d577-548b-494c-8c51-8274635a9955 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.937496 Aug 24 08:55:54.068236 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 23/53] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 08:55:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 2940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:55:54.082173 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-550fe2cc-773d-4060-996c-bdfc092f4266 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:54.083027 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-550fe2cc-773d-4060-996c-bdfc092f4266 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:54.106744 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-550fe2cc-773d-4060-996c-bdfc092f4266 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:54.107669 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-550fe2cc-773d-4060-996c-bdfc092f4266 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:54.108151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-550fe2cc-773d-4060-996c-bdfc092f4266 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:54.112355 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-550fe2cc-773d-4060-996c-bdfc092f4266 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:54.113664 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-550fe2cc-773d-4060-996c-bdfc092f4266 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:54.115255 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-550fe2cc-773d-4060-996c-bdfc092f4266 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:55.048009 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-550fe2cc-773d-4060-996c-bdfc092f4266 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:55.095104 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-550fe2cc-773d-4060-996c-bdfc092f4266 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1226 microversion: 2.1 time: 1.019318 Aug 24 08:55:55.095104 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 24/54] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:54 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1226 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:55.113708 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-724fa4b3-b622-42ad-8b10-b44cb1caa2a3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:55.114521 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-724fa4b3-b622-42ad-8b10-b44cb1caa2a3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:55.123763 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-724fa4b3-b622-42ad-8b10-b44cb1caa2a3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:55.129499 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-724fa4b3-b622-42ad-8b10-b44cb1caa2a3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:55.130221 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-724fa4b3-b622-42ad-8b10-b44cb1caa2a3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:55.131263 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-724fa4b3-b622-42ad-8b10-b44cb1caa2a3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:55.132002 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-724fa4b3-b622-42ad-8b10-b44cb1caa2a3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:55.132550 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-724fa4b3-b622-42ad-8b10-b44cb1caa2a3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:55.438447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-724fa4b3-b622-42ad-8b10-b44cb1caa2a3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:55.483935 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-724fa4b3-b622-42ad-8b10-b44cb1caa2a3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1219 microversion: 2.1 time: 0.387795 Aug 24 08:55:55.500349 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 25/55] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:55 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1219 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:55.522497 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7bed06ef-0881-447a-8c8a-b8bb9049fbfb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:55.524815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7bed06ef-0881-447a-8c8a-b8bb9049fbfb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:55.714293 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7bed06ef-0881-447a-8c8a-b8bb9049fbfb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:55.743523 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7bed06ef-0881-447a-8c8a-b8bb9049fbfb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1238 microversion: 2.1 time: 0.240905 Aug 24 08:55:55.762684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 26/56] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:55 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1238 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:55.763708 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:55:55.766468 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:55:55.767372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:55:55.768144 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-28435829", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:55.769022 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:55:55.769719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:55:55.824336 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:55.825706 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:55.827089 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:55.832212 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:55.835643 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:55.841395 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:55.936878 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] validate_networks() for [('c053db24-71f7-49c0-865c-6fe9c343616a', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:55:55.940705 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Getting quotas for project edeca01476604a70bed160e5aa97607c. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:55:55.953128 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Getting quotas for user f0d0eb9dc0f743c3985218901334b336 and project edeca01476604a70bed160e5aa97607c. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:55:55.989290 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:55:55.991989 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:55:56.171783 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-95a1ad9a-af3e-4f09-b403-2d8f889b489e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.662233 Aug 24 08:55:56.181242 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 31/57] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 24 08:55:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 3673 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 08:55:56.897543 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c31036d8-11ae-40f6-8a44-393c7a9f1de6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Action: 'create', calling method: .version_select at 0x7fb142313a60>, body: {"keypair": {"name": "tempest-keypair-451735605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKo2d/JZcElo2y+kN2CeHb7hdCPO+2D0m8nNd29p3TVLitN28smCeQWzKJJE1NOfLJSN9J7A8zv9paS1/mHbW4htMtdW6EvWT3G8raHV/B5FEXOEcPqKJS6Oi2XN4pNS9Q=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:55:57.017395 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-c31036d8-11ae-40f6-8a44-393c7a9f1de6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Getting quotas for project 7e6183eeb3ff43e79eccb5d7ad08c53c. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:55:57.044126 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-c31036d8-11ae-40f6-8a44-393c7a9f1de6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Getting quotas for user bd0929f371e4442eb4eb6e12a96bbfc4 and project 7e6183eeb3ff43e79eccb5d7ad08c53c. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:55:57.147693 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c31036d8-11ae-40f6-8a44-393c7a9f1de6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.965089 Aug 24 08:55:57.151841 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 32/58] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 24 08:55:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:55:57.181641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0f940a62-aa76-4f98-a0c1-3d39adb4a5e2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:57.185899 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0f940a62-aa76-4f98-a0c1-3d39adb4a5e2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:58.384500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0f940a62-aa76-4f98-a0c1-3d39adb4a5e2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:58.498299 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0f940a62-aa76-4f98-a0c1-3d39adb4a5e2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:58.512325 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0f940a62-aa76-4f98-a0c1-3d39adb4a5e2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:58.533407 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0f940a62-aa76-4f98-a0c1-3d39adb4a5e2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1280 microversion: 2.20 time: 1.373275 Aug 24 08:55:58.537850 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 33/59] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:55:57 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1280 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:55:58.609114 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a3f97907-bb61-4aa4-83ac-d69bbc47d51d tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:58.617712 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a3f97907-bb61-4aa4-83ac-d69bbc47d51d tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:58.655497 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3f97907-bb61-4aa4-83ac-d69bbc47d51d tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:58.656043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3f97907-bb61-4aa4-83ac-d69bbc47d51d tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:58.656562 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3f97907-bb61-4aa4-83ac-d69bbc47d51d tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:58.657330 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3f97907-bb61-4aa4-83ac-d69bbc47d51d tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:58.658009 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3f97907-bb61-4aa4-83ac-d69bbc47d51d tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:58.658482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a3f97907-bb61-4aa4-83ac-d69bbc47d51d tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:58.940937 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:55:58.942069 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:55:58.942717 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:55:58.943299 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:55:58.943901 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:55:58.989935 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:58.990467 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:58.990924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:58.991756 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:59.004920 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:59.006402 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:59.086551 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Getting quotas for project b5cb111df3ec4249a836518a598063a4. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:55:59.101400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Getting quotas for user 8ee5364270094596b64b08a8ac56f6ce and project b5cb111df3ec4249a836518a598063a4. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:55:59.149543 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:55:59.153203 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:55:59.388693 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cbf83880-413d-4301-ac2c-cfb8d8b0a0a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.624598 Aug 24 08:55:59.407526 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 27/60] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 08:55:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 3644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:55:59.417528 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cdcab84a-8fc5-41de-aa8d-8ccca1f56333 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:59.436355 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cdcab84a-8fc5-41de-aa8d-8ccca1f56333 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:55:59.505323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdcab84a-8fc5-41de-aa8d-8ccca1f56333 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:59.506405 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdcab84a-8fc5-41de-aa8d-8ccca1f56333 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:59.511298 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdcab84a-8fc5-41de-aa8d-8ccca1f56333 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:59.511533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a3f97907-bb61-4aa4-83ac-d69bbc47d51d tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:55:59.516244 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdcab84a-8fc5-41de-aa8d-8ccca1f56333 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:55:59.516901 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdcab84a-8fc5-41de-aa8d-8ccca1f56333 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:55:59.517355 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cdcab84a-8fc5-41de-aa8d-8ccca1f56333 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:55:59.548166 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a3f97907-bb61-4aa4-83ac-d69bbc47d51d tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1273 microversion: 2.1 time: 0.998280 Aug 24 08:55:59.556819 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 34/61] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:58 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1273 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:55:59.586620 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1a25eb64-c2af-4f8e-a6b4-01cd1b4de6ed tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:55:59.594185 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1a25eb64-c2af-4f8e-a6b4-01cd1b4de6ed tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:00.985297 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1a25eb64-c2af-4f8e-a6b4-01cd1b4de6ed tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:01.008986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1a25eb64-c2af-4f8e-a6b4-01cd1b4de6ed tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1220 microversion: 2.1 time: 1.439844 Aug 24 08:56:01.011942 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 35/62] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:59 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1220 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:01.053352 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d61866ab-7401-48b4-805c-f7dd3ac39514 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:01.054059 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d61866ab-7401-48b4-805c-f7dd3ac39514 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:01.103169 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d61866ab-7401-48b4-805c-f7dd3ac39514 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:01.103750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d61866ab-7401-48b4-805c-f7dd3ac39514 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:01.104363 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d61866ab-7401-48b4-805c-f7dd3ac39514 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:01.105243 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d61866ab-7401-48b4-805c-f7dd3ac39514 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:01.119172 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cdcab84a-8fc5-41de-aa8d-8ccca1f56333 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:01.125423 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d61866ab-7401-48b4-805c-f7dd3ac39514 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:01.135861 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d61866ab-7401-48b4-805c-f7dd3ac39514 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:01.183775 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cdcab84a-8fc5-41de-aa8d-8ccca1f56333 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1296 microversion: 2.1 time: 1.767711 Aug 24 08:56:01.192135 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 28/63] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:55:59 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1296 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:01.338970 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bda4baf4-e50d-40ed-900e-6a075c134d8a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:01.369546 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bda4baf4-e50d-40ed-900e-6a075c134d8a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:01.439849 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bda4baf4-e50d-40ed-900e-6a075c134d8a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:01.452342 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bda4baf4-e50d-40ed-900e-6a075c134d8a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:01.452973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bda4baf4-e50d-40ed-900e-6a075c134d8a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:01.466766 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d61866ab-7401-48b4-805c-f7dd3ac39514 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:01.471858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bda4baf4-e50d-40ed-900e-6a075c134d8a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:01.478749 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bda4baf4-e50d-40ed-900e-6a075c134d8a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:01.481713 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d61866ab-7401-48b4-805c-f7dd3ac39514 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:01.489196 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d61866ab-7401-48b4-805c-f7dd3ac39514 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:01.491505 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bda4baf4-e50d-40ed-900e-6a075c134d8a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:01.494043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d61866ab-7401-48b4-805c-f7dd3ac39514 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1338 microversion: 2.20 time: 0.479778 Aug 24 08:56:01.500737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 36/64] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:01 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1338 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:01.914104 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-bda4baf4-e50d-40ed-900e-6a075c134d8a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:01.939341 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bda4baf4-e50d-40ed-900e-6a075c134d8a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1273 microversion: 2.1 time: 0.700034 Aug 24 08:56:01.944969 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 29/65] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:01 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1273 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:02.055128 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-91c590c2-434a-4e63-bd51-104b49c12b0e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:02.056065 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-91c590c2-434a-4e63-bd51-104b49c12b0e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:02.087378 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91c590c2-434a-4e63-bd51-104b49c12b0e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:02.088562 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91c590c2-434a-4e63-bd51-104b49c12b0e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:02.096258 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91c590c2-434a-4e63-bd51-104b49c12b0e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:02.109879 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91c590c2-434a-4e63-bd51-104b49c12b0e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:02.113044 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91c590c2-434a-4e63-bd51-104b49c12b0e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:02.116463 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91c590c2-434a-4e63-bd51-104b49c12b0e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:02.253923 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0c06996a-1ff8-4eaa-93fe-89a83d19ed12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:02.265183 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0c06996a-1ff8-4eaa-93fe-89a83d19ed12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:02.294472 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c06996a-1ff8-4eaa-93fe-89a83d19ed12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:02.296791 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c06996a-1ff8-4eaa-93fe-89a83d19ed12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:02.304835 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c06996a-1ff8-4eaa-93fe-89a83d19ed12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:02.305976 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c06996a-1ff8-4eaa-93fe-89a83d19ed12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:02.307201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c06996a-1ff8-4eaa-93fe-89a83d19ed12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:02.307972 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c06996a-1ff8-4eaa-93fe-89a83d19ed12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:02.534376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-91c590c2-434a-4e63-bd51-104b49c12b0e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:02.571430 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-91c590c2-434a-4e63-bd51-104b49c12b0e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1272 microversion: 2.1 time: 0.517261 Aug 24 08:56:02.574977 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 37/66] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:02 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1272 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:02.592608 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-215ccaf2-6bcd-41a6-a42f-2914fe59aebb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:02.612318 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-215ccaf2-6bcd-41a6-a42f-2914fe59aebb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:02.638287 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215ccaf2-6bcd-41a6-a42f-2914fe59aebb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:02.652053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215ccaf2-6bcd-41a6-a42f-2914fe59aebb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:02.655500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215ccaf2-6bcd-41a6-a42f-2914fe59aebb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:02.669866 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215ccaf2-6bcd-41a6-a42f-2914fe59aebb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:02.672286 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215ccaf2-6bcd-41a6-a42f-2914fe59aebb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:02.675360 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-215ccaf2-6bcd-41a6-a42f-2914fe59aebb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:02.778642 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0c06996a-1ff8-4eaa-93fe-89a83d19ed12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:02.796578 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0c06996a-1ff8-4eaa-93fe-89a83d19ed12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1296 microversion: 2.1 time: 0.547860 Aug 24 08:56:02.815772 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 30/67] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:02 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1296 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:02.970726 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-78a74831-194a-42ff-8615-10eb6012f7bb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:02.976402 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-78a74831-194a-42ff-8615-10eb6012f7bb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:03.063800 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78a74831-194a-42ff-8615-10eb6012f7bb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:03.065203 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78a74831-194a-42ff-8615-10eb6012f7bb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:03.067782 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78a74831-194a-42ff-8615-10eb6012f7bb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:03.074098 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78a74831-194a-42ff-8615-10eb6012f7bb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:03.085483 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78a74831-194a-42ff-8615-10eb6012f7bb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:03.096289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-78a74831-194a-42ff-8615-10eb6012f7bb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:05.219418 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-215ccaf2-6bcd-41a6-a42f-2914fe59aebb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:05.259113 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-215ccaf2-6bcd-41a6-a42f-2914fe59aebb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:05.279327 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-215ccaf2-6bcd-41a6-a42f-2914fe59aebb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:05.280973 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-215ccaf2-6bcd-41a6-a42f-2914fe59aebb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1338 microversion: 2.20 time: 2.700301 Aug 24 08:56:05.288144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 38/68] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:02 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1338 bytes in 2710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:05.320724 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-43717eb9-b3af-447b-87f8-dc3d084c5760 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:05.328815 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-43717eb9-b3af-447b-87f8-dc3d084c5760 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:05.355261 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43717eb9-b3af-447b-87f8-dc3d084c5760 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:05.357753 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43717eb9-b3af-447b-87f8-dc3d084c5760 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:05.358962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43717eb9-b3af-447b-87f8-dc3d084c5760 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:05.362127 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43717eb9-b3af-447b-87f8-dc3d084c5760 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:05.366379 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43717eb9-b3af-447b-87f8-dc3d084c5760 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:05.371802 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43717eb9-b3af-447b-87f8-dc3d084c5760 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:05.741929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-78a74831-194a-42ff-8615-10eb6012f7bb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:05.812355 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-78a74831-194a-42ff-8615-10eb6012f7bb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1273 microversion: 2.1 time: 2.848629 Aug 24 08:56:05.813479 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 31/69] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:02 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1273 bytes in 2852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:05.856766 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d3d9e399-7ade-4cc0-a7c9-6ab8ccb6b603 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:05.858304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d3d9e399-7ade-4cc0-a7c9-6ab8ccb6b603 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:05.872073 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:05.893512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-43717eb9-b3af-447b-87f8-dc3d084c5760 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:05.908294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-43717eb9-b3af-447b-87f8-dc3d084c5760 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1278 microversion: 2.1 time: 0.618505 Aug 24 08:56:05.910205 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 39/70] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:05 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1278 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:05.933486 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3d9e399-7ade-4cc0-a7c9-6ab8ccb6b603 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:05.936132 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3d9e399-7ade-4cc0-a7c9-6ab8ccb6b603 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:05.939675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3d9e399-7ade-4cc0-a7c9-6ab8ccb6b603 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:05.946741 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3d9e399-7ade-4cc0-a7c9-6ab8ccb6b603 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:05.952292 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3d9e399-7ade-4cc0-a7c9-6ab8ccb6b603 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:05.954754 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d3d9e399-7ade-4cc0-a7c9-6ab8ccb6b603 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:06.330773 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-60d9307c-8f8d-4000-be51-fa012babd867 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:06.334452 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-60d9307c-8f8d-4000-be51-fa012babd867 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:06.351209 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60d9307c-8f8d-4000-be51-fa012babd867 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:06.352144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60d9307c-8f8d-4000-be51-fa012babd867 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:06.353278 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60d9307c-8f8d-4000-be51-fa012babd867 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:06.354585 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60d9307c-8f8d-4000-be51-fa012babd867 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:06.361249 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60d9307c-8f8d-4000-be51-fa012babd867 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:06.369080 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60d9307c-8f8d-4000-be51-fa012babd867 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:07.401913 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-60d9307c-8f8d-4000-be51-fa012babd867 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:07.422724 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-60d9307c-8f8d-4000-be51-fa012babd867 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:07.431323 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-60d9307c-8f8d-4000-be51-fa012babd867 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:07.434166 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-60d9307c-8f8d-4000-be51-fa012babd867 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1338 microversion: 2.20 time: 1.107809 Aug 24 08:56:07.436789 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 40/71] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:06 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1338 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:07.454160 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d8f359a9-5e5e-4c5c-8ae5-504e523736df tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:07.469005 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d8f359a9-5e5e-4c5c-8ae5-504e523736df tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:07.488964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8f359a9-5e5e-4c5c-8ae5-504e523736df tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:07.492743 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8f359a9-5e5e-4c5c-8ae5-504e523736df tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:07.494895 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8f359a9-5e5e-4c5c-8ae5-504e523736df tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:07.498706 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8f359a9-5e5e-4c5c-8ae5-504e523736df tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:07.499435 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8f359a9-5e5e-4c5c-8ae5-504e523736df tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:07.500126 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8f359a9-5e5e-4c5c-8ae5-504e523736df tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:08.361341 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d3d9e399-7ade-4cc0-a7c9-6ab8ccb6b603 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:08.397500 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d3d9e399-7ade-4cc0-a7c9-6ab8ccb6b603 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 2.575195 Aug 24 08:56:08.399612 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 32/72] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:05 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 2579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:08.417937 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-83a4334e-a4ae-44c5-9778-bbc0379068a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:08.420467 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-83a4334e-a4ae-44c5-9778-bbc0379068a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:08.443247 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=9 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:08.450875 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83a4334e-a4ae-44c5-9778-bbc0379068a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:08.451398 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83a4334e-a4ae-44c5-9778-bbc0379068a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:08.451846 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83a4334e-a4ae-44c5-9778-bbc0379068a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:08.453993 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83a4334e-a4ae-44c5-9778-bbc0379068a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:08.457779 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83a4334e-a4ae-44c5-9778-bbc0379068a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:08.458268 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-83a4334e-a4ae-44c5-9778-bbc0379068a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:09.054218 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:09.134984 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=20 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:09.195762 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-83a4334e-a4ae-44c5-9778-bbc0379068a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:09.216747 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d8f359a9-5e5e-4c5c-8ae5-504e523736df tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:09.249940 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d8f359a9-5e5e-4c5c-8ae5-504e523736df tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 1.806653 Aug 24 08:56:09.251087 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 41/73] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:07 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:09.263788 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-83a4334e-a4ae-44c5-9778-bbc0379068a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1278 microversion: 2.1 time: 0.860195 Aug 24 08:56:09.266692 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 33/74] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:08 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1278 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:09.302866 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bcd3da64-4129-4c9f-920e-280f9c1cb3eb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:09.304953 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bcd3da64-4129-4c9f-920e-280f9c1cb3eb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:09.311385 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:09.315733 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcd3da64-4129-4c9f-920e-280f9c1cb3eb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:09.316710 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcd3da64-4129-4c9f-920e-280f9c1cb3eb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:09.317331 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcd3da64-4129-4c9f-920e-280f9c1cb3eb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:09.332416 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcd3da64-4129-4c9f-920e-280f9c1cb3eb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:09.333456 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcd3da64-4129-4c9f-920e-280f9c1cb3eb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:09.335105 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bcd3da64-4129-4c9f-920e-280f9c1cb3eb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:09.431173 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5dbe1403-1381-45f7-8a8b-951c3b674f14 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:09.432120 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5dbe1403-1381-45f7-8a8b-951c3b674f14 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:09.459322 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5dbe1403-1381-45f7-8a8b-951c3b674f14 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:09.460029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5dbe1403-1381-45f7-8a8b-951c3b674f14 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:09.473782 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5dbe1403-1381-45f7-8a8b-951c3b674f14 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:09.474798 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5dbe1403-1381-45f7-8a8b-951c3b674f14 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:09.475531 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5dbe1403-1381-45f7-8a8b-951c3b674f14 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:09.476136 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5dbe1403-1381-45f7-8a8b-951c3b674f14 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:09.927116 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-bcd3da64-4129-4c9f-920e-280f9c1cb3eb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:09.948488 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-bcd3da64-4129-4c9f-920e-280f9c1cb3eb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:09.950932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-bcd3da64-4129-4c9f-920e-280f9c1cb3eb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:09.951421 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bcd3da64-4129-4c9f-920e-280f9c1cb3eb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.691018 Aug 24 08:56:09.952215 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 42/75] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:09 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:09.984436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-861927089", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42dddf86-1ed2-4180-bf35-64505e861ee8"}], "security_groups": [{"name": "tempest-securitygroup--2117418473"}], "key_name": "tempest-keypair-451735605", "user_data": "}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:10.298767 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5dbe1403-1381-45f7-8a8b-951c3b674f14 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:10.312484 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5dbe1403-1381-45f7-8a8b-951c3b674f14 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.892534 Aug 24 08:56:10.316658 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 34/76] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:09 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:10.343960 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1278a032-d71b-46ab-9857-971526ef3d7e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:10.346550 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1278a032-d71b-46ab-9857-971526ef3d7e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:10.363261 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1278a032-d71b-46ab-9857-971526ef3d7e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:10.363769 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1278a032-d71b-46ab-9857-971526ef3d7e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:10.364251 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1278a032-d71b-46ab-9857-971526ef3d7e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:10.370122 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1278a032-d71b-46ab-9857-971526ef3d7e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:10.370655 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1278a032-d71b-46ab-9857-971526ef3d7e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:10.373779 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1278a032-d71b-46ab-9857-971526ef3d7e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:10.607593 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] validate_networks() for [('42dddf86-1ed2-4180-bf35-64505e861ee8', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:56:10.998412 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=28 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:11.087882 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1278a032-d71b-46ab-9857-971526ef3d7e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:11.105001 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1278a032-d71b-46ab-9857-971526ef3d7e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.773257 Aug 24 08:56:11.120813 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 35/77] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:10 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:11.127547 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-10820fe3-941a-4c1e-8be0-9cdd422863c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:11.128223 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-10820fe3-941a-4c1e-8be0-9cdd422863c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:11.135330 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10820fe3-941a-4c1e-8be0-9cdd422863c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:11.136138 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10820fe3-941a-4c1e-8be0-9cdd422863c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:11.136768 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10820fe3-941a-4c1e-8be0-9cdd422863c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:11.137681 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10820fe3-941a-4c1e-8be0-9cdd422863c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:11.140244 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10820fe3-941a-4c1e-8be0-9cdd422863c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:11.140988 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-10820fe3-941a-4c1e-8be0-9cdd422863c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:11.950148 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-10820fe3-941a-4c1e-8be0-9cdd422863c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:11.976019 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-10820fe3-941a-4c1e-8be0-9cdd422863c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.850517 Aug 24 08:56:12.011635 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 36/78] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:11 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:12.034351 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6c9f720a-da82-49a3-a41c-e8a00c92293b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:12.041051 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6c9f720a-da82-49a3-a41c-e8a00c92293b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:12.071799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c9f720a-da82-49a3-a41c-e8a00c92293b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:12.077221 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c9f720a-da82-49a3-a41c-e8a00c92293b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:12.082180 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c9f720a-da82-49a3-a41c-e8a00c92293b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:12.084863 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c9f720a-da82-49a3-a41c-e8a00c92293b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:12.091281 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c9f720a-da82-49a3-a41c-e8a00c92293b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:12.091995 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c9f720a-da82-49a3-a41c-e8a00c92293b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:12.496705 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:56:12.500310 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:56:12.503998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:56:12.505004 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:56:12.506650 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:56:12.550210 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:12.550850 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:12.556502 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:12.557687 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:12.574918 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:12.576889 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:12.653925 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Getting quotas for project 7e6183eeb3ff43e79eccb5d7ad08c53c. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:56:12.665380 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Getting quotas for user bd0929f371e4442eb4eb6e12a96bbfc4 and project 7e6183eeb3ff43e79eccb5d7ad08c53c. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:56:12.706044 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:56:12.708767 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:56:12.828401 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c415047f-e865-440a-a90a-a8c7ca7beaa1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.862250 Aug 24 08:56:12.844580 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 43/79] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 08:56:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 2892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:56:12.849960 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-01eae391-8144-4ac5-b516-1bf4d82ccf1b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:12.850591 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-01eae391-8144-4ac5-b516-1bf4d82ccf1b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:12.869724 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01eae391-8144-4ac5-b516-1bf4d82ccf1b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:12.875866 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01eae391-8144-4ac5-b516-1bf4d82ccf1b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:12.878734 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01eae391-8144-4ac5-b516-1bf4d82ccf1b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:12.879699 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01eae391-8144-4ac5-b516-1bf4d82ccf1b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:12.880438 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01eae391-8144-4ac5-b516-1bf4d82ccf1b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:12.881044 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01eae391-8144-4ac5-b516-1bf4d82ccf1b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:13.223711 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6c9f720a-da82-49a3-a41c-e8a00c92293b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:13.252658 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6c9f720a-da82-49a3-a41c-e8a00c92293b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:13.256750 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6c9f720a-da82-49a3-a41c-e8a00c92293b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:13.265400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6c9f720a-da82-49a3-a41c-e8a00c92293b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 1.249425 Aug 24 08:56:13.270912 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 37/80] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:12 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:14.044175 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-352be3de-9d81-4b9d-a8fd-d1af00ee7610 req-fe045629-68b3-4aba-9ae9-990fff9ae6ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2489f27e-e91b-4e45-8072-7b4226f576f8", "tag": "f0b3f7af-883a-42f4-9c61-d5a909fd1e9a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:14.066466 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-352be3de-9d81-4b9d-a8fd-d1af00ee7610 req-fe045629-68b3-4aba-9ae9-990fff9ae6ba service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:14.066973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-352be3de-9d81-4b9d-a8fd-d1af00ee7610 req-fe045629-68b3-4aba-9ae9-990fff9ae6ba service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:14.067416 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-352be3de-9d81-4b9d-a8fd-d1af00ee7610 req-fe045629-68b3-4aba-9ae9-990fff9ae6ba service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:14.108530 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-352be3de-9d81-4b9d-a8fd-d1af00ee7610 req-fe045629-68b3-4aba-9ae9-990fff9ae6ba service nova] Creating event network-changed:f0b3f7af-883a-42f4-9c61-d5a909fd1e9a for instance 2489f27e-e91b-4e45-8072-7b4226f576f8 on hv-cinder-83538 Aug 24 08:56:14.109065 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-352be3de-9d81-4b9d-a8fd-d1af00ee7610 req-fe045629-68b3-4aba-9ae9-990fff9ae6ba service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 08:56:14.120785 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-352be3de-9d81-4b9d-a8fd-d1af00ee7610 req-fe045629-68b3-4aba-9ae9-990fff9ae6ba service nova] Acquired lock "compute-rpcapi-router" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 08:56:14.122401 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-073b9443-d1b8-41c6-be4a-26d5b42a7b79 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:14.123108 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-073b9443-d1b8-41c6-be4a-26d5b42a7b79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:14.123708 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-073b9443-d1b8-41c6-be4a-26d5b42a7b79 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:14.124653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-073b9443-d1b8-41c6-be4a-26d5b42a7b79 None None] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:14.125291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-073b9443-d1b8-41c6-be4a-26d5b42a7b79 None None] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:14.125963 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-073b9443-d1b8-41c6-be4a-26d5b42a7b79 None None] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:14.146788 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.compute.rpcapi [None req-073b9443-d1b8-41c6-be4a-26d5b42a7b79 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 08:56:14.147891 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-073b9443-d1b8-41c6-be4a-26d5b42a7b79 None None] Releasing lock "compute-rpcapi-router" {{(pid=120542) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 08:56:14.172462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-01eae391-8144-4ac5-b516-1bf4d82ccf1b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:14.183673 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-01eae391-8144-4ac5-b516-1bf4d82ccf1b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 1.337829 Aug 24 08:56:14.189824 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 44/81] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:12 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:14.224747 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-073b9443-d1b8-41c6-be4a-26d5b42a7b79 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.950526 Aug 24 08:56:14.226206 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 38/82] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:14.228934 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-08b1729e-e0c9-4e31-8437-5c1f97d22d53 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:14.229766 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-08b1729e-e0c9-4e31-8437-5c1f97d22d53 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:14.238380 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a5353286-1725-4ae0-8072-88d490e43468 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:14.239103 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a5353286-1725-4ae0-8072-88d490e43468 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:14.263949 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08b1729e-e0c9-4e31-8437-5c1f97d22d53 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:14.264507 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08b1729e-e0c9-4e31-8437-5c1f97d22d53 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:14.264920 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08b1729e-e0c9-4e31-8437-5c1f97d22d53 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:14.265646 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08b1729e-e0c9-4e31-8437-5c1f97d22d53 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:14.266109 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08b1729e-e0c9-4e31-8437-5c1f97d22d53 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:14.267055 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-08b1729e-e0c9-4e31-8437-5c1f97d22d53 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:14.889678 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a5353286-1725-4ae0-8072-88d490e43468 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:14.904979 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a5353286-1725-4ae0-8072-88d490e43468 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1240 microversion: 2.1 time: 0.676456 Aug 24 08:56:14.941155 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 39/83] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:14 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1240 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:14.997715 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-becff5c9-b23d-490e-a598-3a6dc366b430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:14.999089 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-becff5c9-b23d-490e-a598-3a6dc366b430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:15.028614 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-becff5c9-b23d-490e-a598-3a6dc366b430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:15.029748 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-becff5c9-b23d-490e-a598-3a6dc366b430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:15.034838 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-becff5c9-b23d-490e-a598-3a6dc366b430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:15.040001 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-becff5c9-b23d-490e-a598-3a6dc366b430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:15.042179 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-becff5c9-b23d-490e-a598-3a6dc366b430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:15.046416 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-becff5c9-b23d-490e-a598-3a6dc366b430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:15.962740 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-08b1729e-e0c9-4e31-8437-5c1f97d22d53 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:15.981483 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-08b1729e-e0c9-4e31-8437-5c1f97d22d53 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 1.778044 Aug 24 08:56:15.999217 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 45/84] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:14 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:16.232911 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-63193d25-578c-4641-98ab-19c3a6c4e2dd req-7e844ca5-b413-4de8-8ebf-93f2fb656412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9fe4277-954f-428e-8652-af3bbf1f0977", "tag": "11b3a920-2e8c-4bc1-beec-00dad8bb96b6"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:16.272428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-63193d25-578c-4641-98ab-19c3a6c4e2dd req-7e844ca5-b413-4de8-8ebf-93f2fb656412 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:16.275263 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-63193d25-578c-4641-98ab-19c3a6c4e2dd req-7e844ca5-b413-4de8-8ebf-93f2fb656412 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:16.276874 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-63193d25-578c-4641-98ab-19c3a6c4e2dd req-7e844ca5-b413-4de8-8ebf-93f2fb656412 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:16.335775 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-63193d25-578c-4641-98ab-19c3a6c4e2dd req-7e844ca5-b413-4de8-8ebf-93f2fb656412 service nova] Creating event network-changed:11b3a920-2e8c-4bc1-beec-00dad8bb96b6 for instance f9fe4277-954f-428e-8652-af3bbf1f0977 on hv-cinder-83538 Aug 24 08:56:16.337496 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-63193d25-578c-4641-98ab-19c3a6c4e2dd req-7e844ca5-b413-4de8-8ebf-93f2fb656412 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 08:56:16.343669 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-63193d25-578c-4641-98ab-19c3a6c4e2dd req-7e844ca5-b413-4de8-8ebf-93f2fb656412 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 08:56:16.346559 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bceab64e-8bf0-45ec-a890-d2b5a4e150b6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:16.347576 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bceab64e-8bf0-45ec-a890-d2b5a4e150b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:16.349432 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bceab64e-8bf0-45ec-a890-d2b5a4e150b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:16.355117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bceab64e-8bf0-45ec-a890-d2b5a4e150b6 None None] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:16.356428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bceab64e-8bf0-45ec-a890-d2b5a4e150b6 None None] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:16.358563 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bceab64e-8bf0-45ec-a890-d2b5a4e150b6 None None] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:16.400121 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.compute.rpcapi [None req-bceab64e-8bf0-45ec-a890-d2b5a4e150b6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 08:56:16.406719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bceab64e-8bf0-45ec-a890-d2b5a4e150b6 None None] Releasing lock "compute-rpcapi-router" {{(pid=120543) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 08:56:16.466098 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bceab64e-8bf0-45ec-a890-d2b5a4e150b6 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.465463 Aug 24 08:56:16.467095 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 46/85] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:16.483728 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4df03650-1974-4a3a-9997-39bb41132e7c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:16.486272 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4df03650-1974-4a3a-9997-39bb41132e7c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:16.512082 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4df03650-1974-4a3a-9997-39bb41132e7c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:16.517340 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4df03650-1974-4a3a-9997-39bb41132e7c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:16.521560 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4df03650-1974-4a3a-9997-39bb41132e7c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:16.539401 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4df03650-1974-4a3a-9997-39bb41132e7c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:16.540488 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4df03650-1974-4a3a-9997-39bb41132e7c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:16.546169 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4df03650-1974-4a3a-9997-39bb41132e7c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:17.004674 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-becff5c9-b23d-490e-a598-3a6dc366b430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:17.024828 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-becff5c9-b23d-490e-a598-3a6dc366b430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 2.081699 Aug 24 08:56:17.025429 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 40/86] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:14 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:17.040740 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0c47f64e-ccae-45b1-9f0b-1e14ce5ad1bc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:17.041795 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0c47f64e-ccae-45b1-9f0b-1e14ce5ad1bc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:17.059673 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c47f64e-ccae-45b1-9f0b-1e14ce5ad1bc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:17.060513 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c47f64e-ccae-45b1-9f0b-1e14ce5ad1bc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:17.060962 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c47f64e-ccae-45b1-9f0b-1e14ce5ad1bc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:17.061757 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c47f64e-ccae-45b1-9f0b-1e14ce5ad1bc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:17.062225 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c47f64e-ccae-45b1-9f0b-1e14ce5ad1bc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:17.062767 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0c47f64e-ccae-45b1-9f0b-1e14ce5ad1bc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:19.338972 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0c47f64e-ccae-45b1-9f0b-1e14ce5ad1bc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:19.340481 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-4df03650-1974-4a3a-9997-39bb41132e7c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:19.350878 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=93 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:19.373326 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=75 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:19.401491 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-4df03650-1974-4a3a-9997-39bb41132e7c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:19.406146 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0c47f64e-ccae-45b1-9f0b-1e14ce5ad1bc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 2.367583 Aug 24 08:56:19.411579 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 41/87] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:17 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 2376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:19.417193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-4df03650-1974-4a3a-9997-39bb41132e7c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:19.438977 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4df03650-1974-4a3a-9997-39bb41132e7c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 2.954355 Aug 24 08:56:19.446835 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 47/88] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:16 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 2979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:19.461875 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4a8566ec-2aaa-4a50-9aa1-9f20a84bf00a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:19.484789 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4a8566ec-2aaa-4a50-9aa1-9f20a84bf00a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:19.495844 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-80853d0c-7f51-4a12-b39a-b351e7ef7b41 req-ddbbaf06-0839-43b3-882e-0342506cf2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6cadaae-8d3b-485a-87a8-cdf9b320b2b8", "tag": "997e8c94-fb8c-46c5-848a-11eb858266eb"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:19.530700 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a8566ec-2aaa-4a50-9aa1-9f20a84bf00a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:19.532144 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a8566ec-2aaa-4a50-9aa1-9f20a84bf00a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:19.535896 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a8566ec-2aaa-4a50-9aa1-9f20a84bf00a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:19.541857 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a8566ec-2aaa-4a50-9aa1-9f20a84bf00a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:19.547062 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a8566ec-2aaa-4a50-9aa1-9f20a84bf00a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:19.558089 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a8566ec-2aaa-4a50-9aa1-9f20a84bf00a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:19.582854 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-80853d0c-7f51-4a12-b39a-b351e7ef7b41 req-ddbbaf06-0839-43b3-882e-0342506cf2e0 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:19.583847 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-80853d0c-7f51-4a12-b39a-b351e7ef7b41 req-ddbbaf06-0839-43b3-882e-0342506cf2e0 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:19.590874 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-80853d0c-7f51-4a12-b39a-b351e7ef7b41 req-ddbbaf06-0839-43b3-882e-0342506cf2e0 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:19.673645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-80853d0c-7f51-4a12-b39a-b351e7ef7b41 req-ddbbaf06-0839-43b3-882e-0342506cf2e0 service nova] Creating event network-changed:997e8c94-fb8c-46c5-848a-11eb858266eb for instance d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 on hv-cinder-83538 Aug 24 08:56:19.691021 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-80853d0c-7f51-4a12-b39a-b351e7ef7b41 req-ddbbaf06-0839-43b3-882e-0342506cf2e0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240407 Aug 24 08:56:19.691918 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 48/89] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:19.702816 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bbbee06b-e2bd-40e6-bd46-6680d734ebda tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:19.704001 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bbbee06b-e2bd-40e6-bd46-6680d734ebda tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:19.713070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbbee06b-e2bd-40e6-bd46-6680d734ebda tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:19.714156 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbbee06b-e2bd-40e6-bd46-6680d734ebda tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:19.715036 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbbee06b-e2bd-40e6-bd46-6680d734ebda tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:19.735532 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbbee06b-e2bd-40e6-bd46-6680d734ebda tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:19.735532 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbbee06b-e2bd-40e6-bd46-6680d734ebda tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:19.735532 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbbee06b-e2bd-40e6-bd46-6680d734ebda tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.153839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-4a8566ec-2aaa-4a50-9aa1-9f20a84bf00a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:20.160795 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-bbbee06b-e2bd-40e6-bd46-6680d734ebda tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:20.178348 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bbbee06b-e2bd-40e6-bd46-6680d734ebda tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.484118 Aug 24 08:56:20.185673 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4a8566ec-2aaa-4a50-9aa1-9f20a84bf00a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.765873 Aug 24 08:56:20.186338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 42/90] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:19 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:20.191782 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-42eace43-5a22-49b9-9044-6bf1f39cd2b9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:20.192451 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-42eace43-5a22-49b9-9044-6bf1f39cd2b9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:20.199363 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42eace43-5a22-49b9-9044-6bf1f39cd2b9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:20.200123 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42eace43-5a22-49b9-9044-6bf1f39cd2b9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:20.200763 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42eace43-5a22-49b9-9044-6bf1f39cd2b9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.201670 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42eace43-5a22-49b9-9044-6bf1f39cd2b9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:20.202140 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42eace43-5a22-49b9-9044-6bf1f39cd2b9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:20.202568 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-42eace43-5a22-49b9-9044-6bf1f39cd2b9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.233035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 49/91] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:19 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:20.243484 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-bcb4e3a3-1583-40a4-b130-d8d4dfef5571 req-a7f3882a-d43d-4a5d-bb1c-cedcd69ad73c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4866e8f4-ddfe-4cee-8bcc-5db7372926f5", "tag": "4e1f25c9-676d-433c-8c1b-ae79e13a1625"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:20.257271 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bcb4e3a3-1583-40a4-b130-d8d4dfef5571 req-a7f3882a-d43d-4a5d-bb1c-cedcd69ad73c service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:20.258135 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bcb4e3a3-1583-40a4-b130-d8d4dfef5571 req-a7f3882a-d43d-4a5d-bb1c-cedcd69ad73c service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:20.258806 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bcb4e3a3-1583-40a4-b130-d8d4dfef5571 req-a7f3882a-d43d-4a5d-bb1c-cedcd69ad73c service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.292734 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-bcb4e3a3-1583-40a4-b130-d8d4dfef5571 req-a7f3882a-d43d-4a5d-bb1c-cedcd69ad73c service nova] Creating event network-changed:4e1f25c9-676d-433c-8c1b-ae79e13a1625 for instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 on hv-cinder-83538 Aug 24 08:56:20.300342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-bcb4e3a3-1583-40a4-b130-d8d4dfef5571 req-a7f3882a-d43d-4a5d-bb1c-cedcd69ad73c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065286 Aug 24 08:56:20.301992 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 50/92] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:20.418466 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-42eace43-5a22-49b9-9044-6bf1f39cd2b9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:20.427334 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-42eace43-5a22-49b9-9044-6bf1f39cd2b9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.239712 Aug 24 08:56:20.428036 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 43/93] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:20 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:20.456655 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d7e1a25f-bdf5-4863-9956-5f3096f32a9d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:20.457868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d7e1a25f-bdf5-4863-9956-5f3096f32a9d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:20.465754 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7e1a25f-bdf5-4863-9956-5f3096f32a9d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:20.466410 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7e1a25f-bdf5-4863-9956-5f3096f32a9d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:20.466987 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7e1a25f-bdf5-4863-9956-5f3096f32a9d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.467846 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7e1a25f-bdf5-4863-9956-5f3096f32a9d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:20.468735 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7e1a25f-bdf5-4863-9956-5f3096f32a9d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:20.470089 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7e1a25f-bdf5-4863-9956-5f3096f32a9d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.474674 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-722259e9-c23b-4bd1-9ab1-bbf3398d3ee2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:20.475298 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-722259e9-c23b-4bd1-9ab1-bbf3398d3ee2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:20.481983 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-722259e9-c23b-4bd1-9ab1-bbf3398d3ee2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:20.482475 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-722259e9-c23b-4bd1-9ab1-bbf3398d3ee2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:20.483573 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-722259e9-c23b-4bd1-9ab1-bbf3398d3ee2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.484761 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-722259e9-c23b-4bd1-9ab1-bbf3398d3ee2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:20.485439 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-722259e9-c23b-4bd1-9ab1-bbf3398d3ee2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:20.486260 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-722259e9-c23b-4bd1-9ab1-bbf3398d3ee2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:20.743095 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-722259e9-c23b-4bd1-9ab1-bbf3398d3ee2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:20.756015 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-722259e9-c23b-4bd1-9ab1-bbf3398d3ee2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:20.757781 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-722259e9-c23b-4bd1-9ab1-bbf3398d3ee2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:20.758985 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-722259e9-c23b-4bd1-9ab1-bbf3398d3ee2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.288720 Aug 24 08:56:20.768056 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d7e1a25f-bdf5-4863-9956-5f3096f32a9d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:20.776492 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 44/94] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:20 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:20.791802 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d7e1a25f-bdf5-4863-9956-5f3096f32a9d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.343979 Aug 24 08:56:20.796566 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 51/95] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:20 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:21.244128 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d5e5757e-b4b3-4210-bdc9-feaf47fa4858 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:21.245383 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d5e5757e-b4b3-4210-bdc9-feaf47fa4858 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:21.254369 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5e5757e-b4b3-4210-bdc9-feaf47fa4858 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.255376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5e5757e-b4b3-4210-bdc9-feaf47fa4858 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.256382 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5e5757e-b4b3-4210-bdc9-feaf47fa4858 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.257421 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5e5757e-b4b3-4210-bdc9-feaf47fa4858 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.258113 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5e5757e-b4b3-4210-bdc9-feaf47fa4858 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.258774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5e5757e-b4b3-4210-bdc9-feaf47fa4858 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.267715 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-02063941-0915-4d35-9fb1-7afd77ba9741 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:21.270601 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-02063941-0915-4d35-9fb1-7afd77ba9741 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:21.290158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02063941-0915-4d35-9fb1-7afd77ba9741 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.290669 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02063941-0915-4d35-9fb1-7afd77ba9741 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.291115 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02063941-0915-4d35-9fb1-7afd77ba9741 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.295266 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02063941-0915-4d35-9fb1-7afd77ba9741 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.295744 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02063941-0915-4d35-9fb1-7afd77ba9741 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.296552 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-02063941-0915-4d35-9fb1-7afd77ba9741 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.590822 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d5e5757e-b4b3-4210-bdc9-feaf47fa4858 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:21.601348 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-02063941-0915-4d35-9fb1-7afd77ba9741 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:21.610547 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-02063941-0915-4d35-9fb1-7afd77ba9741 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.392106 Aug 24 08:56:21.614926 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d5e5757e-b4b3-4210-bdc9-feaf47fa4858 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.376139 Aug 24 08:56:21.616650 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 45/96] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:21 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:21.622644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 52/97] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:21 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:21.624954 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e15e7ab2-1307-4e1e-ab54-85cff43afb47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:21.625821 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e15e7ab2-1307-4e1e-ab54-85cff43afb47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:21.646504 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e15e7ab2-1307-4e1e-ab54-85cff43afb47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.647027 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e15e7ab2-1307-4e1e-ab54-85cff43afb47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.647691 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e15e7ab2-1307-4e1e-ab54-85cff43afb47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.649004 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e15e7ab2-1307-4e1e-ab54-85cff43afb47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.649861 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e15e7ab2-1307-4e1e-ab54-85cff43afb47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.650353 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e15e7ab2-1307-4e1e-ab54-85cff43afb47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.804891 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5109e6bb-9acf-4f41-a90e-1affe0e1a546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:21.810217 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5109e6bb-9acf-4f41-a90e-1affe0e1a546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:21.818260 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5109e6bb-9acf-4f41-a90e-1affe0e1a546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.819336 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5109e6bb-9acf-4f41-a90e-1affe0e1a546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.820404 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5109e6bb-9acf-4f41-a90e-1affe0e1a546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.821206 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5109e6bb-9acf-4f41-a90e-1affe0e1a546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.821709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5109e6bb-9acf-4f41-a90e-1affe0e1a546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.822237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5109e6bb-9acf-4f41-a90e-1affe0e1a546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.869422 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e15e7ab2-1307-4e1e-ab54-85cff43afb47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:21.890669 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e15e7ab2-1307-4e1e-ab54-85cff43afb47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.272646 Aug 24 08:56:21.911879 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 46/98] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:21 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:21.922655 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3df7dccb-499c-484e-8961-c5db9d0adb0a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:21.925044 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3df7dccb-499c-484e-8961-c5db9d0adb0a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:21.940981 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3df7dccb-499c-484e-8961-c5db9d0adb0a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.943088 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3df7dccb-499c-484e-8961-c5db9d0adb0a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.947303 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3df7dccb-499c-484e-8961-c5db9d0adb0a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:21.948327 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3df7dccb-499c-484e-8961-c5db9d0adb0a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:21.951807 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3df7dccb-499c-484e-8961-c5db9d0adb0a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:21.952611 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3df7dccb-499c-484e-8961-c5db9d0adb0a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:22.133076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5109e6bb-9acf-4f41-a90e-1affe0e1a546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:22.145104 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5109e6bb-9acf-4f41-a90e-1affe0e1a546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:22.147197 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5109e6bb-9acf-4f41-a90e-1affe0e1a546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:22.148405 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5109e6bb-9acf-4f41-a90e-1affe0e1a546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.350571 Aug 24 08:56:22.163667 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 53/99] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:21 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:22.218224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3df7dccb-499c-484e-8961-c5db9d0adb0a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:22.229248 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3df7dccb-499c-484e-8961-c5db9d0adb0a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.315959 Aug 24 08:56:22.230121 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 47/100] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:21 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:22.324631 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-6a077e55-ef47-455f-a1bb-8260be297286 req-618356bc-a5b3-4a39-a4bc-6954e307b1df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa211fc0-831d-4d6f-863e-b44a4c49f382", "tag": "80cea5be-668b-4485-bc47-616ebf607678"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:22.341292 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6a077e55-ef47-455f-a1bb-8260be297286 req-618356bc-a5b3-4a39-a4bc-6954e307b1df service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:22.342081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6a077e55-ef47-455f-a1bb-8260be297286 req-618356bc-a5b3-4a39-a4bc-6954e307b1df service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:22.342788 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6a077e55-ef47-455f-a1bb-8260be297286 req-618356bc-a5b3-4a39-a4bc-6954e307b1df service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:22.367421 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-6a077e55-ef47-455f-a1bb-8260be297286 req-618356bc-a5b3-4a39-a4bc-6954e307b1df service nova] Creating event network-changed:80cea5be-668b-4485-bc47-616ebf607678 for instance aa211fc0-831d-4d6f-863e-b44a4c49f382 on hv-cinder-83538 Aug 24 08:56:22.375709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-6a077e55-ef47-455f-a1bb-8260be297286 req-618356bc-a5b3-4a39-a4bc-6954e307b1df service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056724 Aug 24 08:56:22.377939 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 54/101] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:22.654211 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ecaa369c-da38-4bbd-825e-940a6ae4276b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:22.655263 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e2f0226e-21c2-4684-93fa-4932c241ae48 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:22.655805 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ecaa369c-da38-4bbd-825e-940a6ae4276b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:22.656933 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e2f0226e-21c2-4684-93fa-4932c241ae48 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:22.672791 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecaa369c-da38-4bbd-825e-940a6ae4276b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:22.674048 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecaa369c-da38-4bbd-825e-940a6ae4276b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:22.675505 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecaa369c-da38-4bbd-825e-940a6ae4276b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:22.677382 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecaa369c-da38-4bbd-825e-940a6ae4276b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:22.678518 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecaa369c-da38-4bbd-825e-940a6ae4276b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:22.689593 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2f0226e-21c2-4684-93fa-4932c241ae48 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:22.690651 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2f0226e-21c2-4684-93fa-4932c241ae48 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:22.691532 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ecaa369c-da38-4bbd-825e-940a6ae4276b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:22.692322 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2f0226e-21c2-4684-93fa-4932c241ae48 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:22.694141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2f0226e-21c2-4684-93fa-4932c241ae48 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:22.696505 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2f0226e-21c2-4684-93fa-4932c241ae48 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:22.697822 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e2f0226e-21c2-4684-93fa-4932c241ae48 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:22.699524 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:23.868326 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e2f0226e-21c2-4684-93fa-4932c241ae48 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:23.876892 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e2f0226e-21c2-4684-93fa-4932c241ae48 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 1.233543 Aug 24 08:56:23.877438 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 55/102] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:22 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:23.900467 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-de69b0b7-66c6-4aa4-b42a-b84db2f22558 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:23.901090 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-de69b0b7-66c6-4aa4-b42a-b84db2f22558 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:23.915670 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de69b0b7-66c6-4aa4-b42a-b84db2f22558 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:23.916207 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de69b0b7-66c6-4aa4-b42a-b84db2f22558 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:23.916657 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de69b0b7-66c6-4aa4-b42a-b84db2f22558 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:23.917396 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de69b0b7-66c6-4aa4-b42a-b84db2f22558 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:23.917861 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de69b0b7-66c6-4aa4-b42a-b84db2f22558 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:23.918298 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de69b0b7-66c6-4aa4-b42a-b84db2f22558 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:23.940916 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ecaa369c-da38-4bbd-825e-940a6ae4276b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:23.949936 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ecaa369c-da38-4bbd-825e-940a6ae4276b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 1.306196 Aug 24 08:56:23.965078 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 48/103] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:22 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:23.981870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d6040c9b-8950-485b-b53c-48222c1d5247 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:23.984038 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d6040c9b-8950-485b-b53c-48222c1d5247 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:24.011897 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6040c9b-8950-485b-b53c-48222c1d5247 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:24.013039 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6040c9b-8950-485b-b53c-48222c1d5247 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:24.016416 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6040c9b-8950-485b-b53c-48222c1d5247 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:24.019568 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6040c9b-8950-485b-b53c-48222c1d5247 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:24.020527 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6040c9b-8950-485b-b53c-48222c1d5247 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:24.023428 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6040c9b-8950-485b-b53c-48222c1d5247 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:24.177343 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:24.279411 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-de69b0b7-66c6-4aa4-b42a-b84db2f22558 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:24.314211 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-de69b0b7-66c6-4aa4-b42a-b84db2f22558 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.417234 Aug 24 08:56:24.316241 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 56/104] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:23 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:24.330801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f918731d-4c5e-413a-9844-09f351a4dd6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:24.332548 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f918731d-4c5e-413a-9844-09f351a4dd6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:24.347538 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f918731d-4c5e-413a-9844-09f351a4dd6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:24.348613 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f918731d-4c5e-413a-9844-09f351a4dd6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:24.350105 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f918731d-4c5e-413a-9844-09f351a4dd6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:24.352049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f918731d-4c5e-413a-9844-09f351a4dd6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:24.354369 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f918731d-4c5e-413a-9844-09f351a4dd6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:24.355509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f918731d-4c5e-413a-9844-09f351a4dd6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:24.427193 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d6040c9b-8950-485b-b53c-48222c1d5247 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:24.443540 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d6040c9b-8950-485b-b53c-48222c1d5247 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:24.446823 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d6040c9b-8950-485b-b53c-48222c1d5247 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:24.449039 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d6040c9b-8950-485b-b53c-48222c1d5247 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.482152 Aug 24 08:56:24.464130 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 49/105] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:23 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:24.471667 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ce7b22e8-3ee6-4598-aebe-e433ab52472a req-fa806dbb-3b46-44fc-b244-6b546986f733 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e52bd97-9ce6-4cc5-bd9a-3218b1a23645", "tag": "3da9d3b1-4548-4832-aac1-7c9959b42dc0"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:24.483198 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ce7b22e8-3ee6-4598-aebe-e433ab52472a req-fa806dbb-3b46-44fc-b244-6b546986f733 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:24.483687 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ce7b22e8-3ee6-4598-aebe-e433ab52472a req-fa806dbb-3b46-44fc-b244-6b546986f733 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:24.484166 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ce7b22e8-3ee6-4598-aebe-e433ab52472a req-fa806dbb-3b46-44fc-b244-6b546986f733 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:24.508674 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ce7b22e8-3ee6-4598-aebe-e433ab52472a req-fa806dbb-3b46-44fc-b244-6b546986f733 service nova] Creating event network-changed:3da9d3b1-4548-4832-aac1-7c9959b42dc0 for instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 on hv-cinder-83538 Aug 24 08:56:24.516445 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ce7b22e8-3ee6-4598-aebe-e433ab52472a req-fa806dbb-3b46-44fc-b244-6b546986f733 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064144 Aug 24 08:56:24.517311 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 50/106] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:24.566646 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f918731d-4c5e-413a-9844-09f351a4dd6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:24.580829 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f918731d-4c5e-413a-9844-09f351a4dd6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.261724 Aug 24 08:56:24.581943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 57/107] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:24 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:24.899402 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c546b1af-c03b-44c2-a0dd-9572f85a1a49 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:24.900535 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c546b1af-c03b-44c2-a0dd-9572f85a1a49 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:24.902672 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:24.910580 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c546b1af-c03b-44c2-a0dd-9572f85a1a49 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:24.911098 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c546b1af-c03b-44c2-a0dd-9572f85a1a49 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:24.911538 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c546b1af-c03b-44c2-a0dd-9572f85a1a49 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:24.912506 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c546b1af-c03b-44c2-a0dd-9572f85a1a49 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:24.912976 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c546b1af-c03b-44c2-a0dd-9572f85a1a49 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:24.913411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c546b1af-c03b-44c2-a0dd-9572f85a1a49 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:24.977329 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-96715fea-b85c-4a6f-9028-6c3fb0460661 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:24.978185 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-96715fea-b85c-4a6f-9028-6c3fb0460661 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:24.984836 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96715fea-b85c-4a6f-9028-6c3fb0460661 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:24.985500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96715fea-b85c-4a6f-9028-6c3fb0460661 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:24.987043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96715fea-b85c-4a6f-9028-6c3fb0460661 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:24.988559 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96715fea-b85c-4a6f-9028-6c3fb0460661 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:24.989334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96715fea-b85c-4a6f-9028-6c3fb0460661 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:24.990017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-96715fea-b85c-4a6f-9028-6c3fb0460661 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:25.214759 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c546b1af-c03b-44c2-a0dd-9572f85a1a49 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:25.228049 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c546b1af-c03b-44c2-a0dd-9572f85a1a49 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.332939 Aug 24 08:56:25.229267 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 51/108] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:24 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:25.241443 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-96715fea-b85c-4a6f-9028-6c3fb0460661 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:25.259549 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-96715fea-b85c-4a6f-9028-6c3fb0460661 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.286268 Aug 24 08:56:25.275648 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 58/109] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:24 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:25.353831 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8050f163-f0f9-4e34-9017-6dbb24efa089 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:25.354732 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8050f163-f0f9-4e34-9017-6dbb24efa089 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:25.365208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8050f163-f0f9-4e34-9017-6dbb24efa089 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:25.365725 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8050f163-f0f9-4e34-9017-6dbb24efa089 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:25.366387 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8050f163-f0f9-4e34-9017-6dbb24efa089 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:25.367326 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8050f163-f0f9-4e34-9017-6dbb24efa089 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:25.367998 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8050f163-f0f9-4e34-9017-6dbb24efa089 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:25.368585 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8050f163-f0f9-4e34-9017-6dbb24efa089 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:25.493754 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63442da5-8224-4b79-b310-8ceebfc13dc7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:25.494648 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-63442da5-8224-4b79-b310-8ceebfc13dc7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:25.503797 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63442da5-8224-4b79-b310-8ceebfc13dc7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:25.504988 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63442da5-8224-4b79-b310-8ceebfc13dc7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:25.505869 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63442da5-8224-4b79-b310-8ceebfc13dc7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:25.507638 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63442da5-8224-4b79-b310-8ceebfc13dc7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:25.508679 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63442da5-8224-4b79-b310-8ceebfc13dc7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:25.510150 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63442da5-8224-4b79-b310-8ceebfc13dc7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:25.582908 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8050f163-f0f9-4e34-9017-6dbb24efa089 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:25.602495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8050f163-f0f9-4e34-9017-6dbb24efa089 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.258789 Aug 24 08:56:25.616625 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 52/110] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:25 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:25.621574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2e125d74-db67-4d90-a5ed-a56825bb6f7c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:25.622203 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2e125d74-db67-4d90-a5ed-a56825bb6f7c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:25.629007 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e125d74-db67-4d90-a5ed-a56825bb6f7c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:25.629914 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e125d74-db67-4d90-a5ed-a56825bb6f7c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:25.630533 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e125d74-db67-4d90-a5ed-a56825bb6f7c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:25.631475 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e125d74-db67-4d90-a5ed-a56825bb6f7c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:25.632181 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e125d74-db67-4d90-a5ed-a56825bb6f7c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:25.632845 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e125d74-db67-4d90-a5ed-a56825bb6f7c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:25.759785 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-63442da5-8224-4b79-b310-8ceebfc13dc7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:25.771520 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-63442da5-8224-4b79-b310-8ceebfc13dc7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:25.773226 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-63442da5-8224-4b79-b310-8ceebfc13dc7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:25.774504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-63442da5-8224-4b79-b310-8ceebfc13dc7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.302002 Aug 24 08:56:25.775017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 59/111] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:25 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:25.864619 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2e125d74-db67-4d90-a5ed-a56825bb6f7c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:25.872810 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2e125d74-db67-4d90-a5ed-a56825bb6f7c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.255132 Aug 24 08:56:25.873686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 53/112] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:25 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:26.254010 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-781a7bfa-767b-43e6-bce7-ceac4dd3b8ab tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:26.255066 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-781a7bfa-767b-43e6-bce7-ceac4dd3b8ab tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:26.265864 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-781a7bfa-767b-43e6-bce7-ceac4dd3b8ab tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.266726 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-781a7bfa-767b-43e6-bce7-ceac4dd3b8ab tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.268469 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-781a7bfa-767b-43e6-bce7-ceac4dd3b8ab tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.269814 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-781a7bfa-767b-43e6-bce7-ceac4dd3b8ab tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.270661 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-781a7bfa-767b-43e6-bce7-ceac4dd3b8ab tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.271437 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-781a7bfa-767b-43e6-bce7-ceac4dd3b8ab tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.285181 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8daf4f48-944f-42fd-8f20-ce6c29222424 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:26.285842 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8daf4f48-944f-42fd-8f20-ce6c29222424 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:26.293060 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8daf4f48-944f-42fd-8f20-ce6c29222424 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.293681 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8daf4f48-944f-42fd-8f20-ce6c29222424 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.294179 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8daf4f48-944f-42fd-8f20-ce6c29222424 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.295100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8daf4f48-944f-42fd-8f20-ce6c29222424 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.295566 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8daf4f48-944f-42fd-8f20-ce6c29222424 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.296002 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8daf4f48-944f-42fd-8f20-ce6c29222424 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.382559 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:26.652189 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-781a7bfa-767b-43e6-bce7-ceac4dd3b8ab tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:26.657052 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8daf4f48-944f-42fd-8f20-ce6c29222424 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:26.673225 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8daf4f48-944f-42fd-8f20-ce6c29222424 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.392445 Aug 24 08:56:26.673469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 54/113] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:26 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:26.680656 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-781a7bfa-767b-43e6-bce7-ceac4dd3b8ab tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.431105 Aug 24 08:56:26.681929 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 60/114] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:26 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:26.694508 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-11922c31-bac8-4829-a3d8-f70115393ca8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:26.696287 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-11922c31-bac8-4829-a3d8-f70115393ca8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:26.710032 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11922c31-bac8-4829-a3d8-f70115393ca8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.710961 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11922c31-bac8-4829-a3d8-f70115393ca8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.711692 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11922c31-bac8-4829-a3d8-f70115393ca8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.713041 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11922c31-bac8-4829-a3d8-f70115393ca8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.714192 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11922c31-bac8-4829-a3d8-f70115393ca8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.714869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11922c31-bac8-4829-a3d8-f70115393ca8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.810845 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b1364af8-4693-4a57-9e86-5d1e140a8947 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:26.811866 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b1364af8-4693-4a57-9e86-5d1e140a8947 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:26.824229 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1364af8-4693-4a57-9e86-5d1e140a8947 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.825450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1364af8-4693-4a57-9e86-5d1e140a8947 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.826407 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1364af8-4693-4a57-9e86-5d1e140a8947 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:26.827900 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1364af8-4693-4a57-9e86-5d1e140a8947 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:26.829053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1364af8-4693-4a57-9e86-5d1e140a8947 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:26.829822 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b1364af8-4693-4a57-9e86-5d1e140a8947 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:27.013794 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-11922c31-bac8-4829-a3d8-f70115393ca8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:27.026793 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-11922c31-bac8-4829-a3d8-f70115393ca8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.349453 Aug 24 08:56:27.042688 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 55/115] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:26 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:27.050083 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-08a5347a-f99b-4498-9927-749a51d96862 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:27.051066 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-08a5347a-f99b-4498-9927-749a51d96862 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:27.066172 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08a5347a-f99b-4498-9927-749a51d96862 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:27.067402 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08a5347a-f99b-4498-9927-749a51d96862 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:27.068593 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08a5347a-f99b-4498-9927-749a51d96862 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:27.070780 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08a5347a-f99b-4498-9927-749a51d96862 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:27.071854 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08a5347a-f99b-4498-9927-749a51d96862 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:27.073338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08a5347a-f99b-4498-9927-749a51d96862 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:27.146682 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b1364af8-4693-4a57-9e86-5d1e140a8947 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:27.166942 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b1364af8-4693-4a57-9e86-5d1e140a8947 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:27.170223 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b1364af8-4693-4a57-9e86-5d1e140a8947 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:27.172459 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b1364af8-4693-4a57-9e86-5d1e140a8947 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.368969 Aug 24 08:56:27.188243 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 61/116] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:26 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:27.281943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-08a5347a-f99b-4498-9927-749a51d96862 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:27.293966 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-08a5347a-f99b-4498-9927-749a51d96862 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.248511 Aug 24 08:56:27.294665 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 56/117] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:27 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:27.717753 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f93ac33f-56e7-4c2c-ab5b-fcb392fea1d0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:27.718416 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f93ac33f-56e7-4c2c-ab5b-fcb392fea1d0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:27.723073 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6924ddf7-d6a3-4fa9-8c33-69fad6a9c694 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:27.723990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6924ddf7-d6a3-4fa9-8c33-69fad6a9c694 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:27.726552 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f93ac33f-56e7-4c2c-ab5b-fcb392fea1d0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:27.727124 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f93ac33f-56e7-4c2c-ab5b-fcb392fea1d0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:27.727633 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f93ac33f-56e7-4c2c-ab5b-fcb392fea1d0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:27.728328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f93ac33f-56e7-4c2c-ab5b-fcb392fea1d0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:27.728783 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f93ac33f-56e7-4c2c-ab5b-fcb392fea1d0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:27.729228 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f93ac33f-56e7-4c2c-ab5b-fcb392fea1d0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:27.735581 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6924ddf7-d6a3-4fa9-8c33-69fad6a9c694 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:27.736798 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6924ddf7-d6a3-4fa9-8c33-69fad6a9c694 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:27.737638 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6924ddf7-d6a3-4fa9-8c33-69fad6a9c694 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:27.739205 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6924ddf7-d6a3-4fa9-8c33-69fad6a9c694 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:27.740116 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6924ddf7-d6a3-4fa9-8c33-69fad6a9c694 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:27.740952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6924ddf7-d6a3-4fa9-8c33-69fad6a9c694 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:27.971850 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f93ac33f-56e7-4c2c-ab5b-fcb392fea1d0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:27.980315 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f93ac33f-56e7-4c2c-ab5b-fcb392fea1d0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.266735 Aug 24 08:56:27.981515 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 62/118] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:27 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:28.001421 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6924ddf7-d6a3-4fa9-8c33-69fad6a9c694 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:28.009970 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6924ddf7-d6a3-4fa9-8c33-69fad6a9c694 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.292804 Aug 24 08:56:28.010934 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 57/119] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:27 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:28.056017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d87e49f1-e83d-45f3-bafd-00c8d180f633 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:28.056941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d87e49f1-e83d-45f3-bafd-00c8d180f633 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:28.065690 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87e49f1-e83d-45f3-bafd-00c8d180f633 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:28.066508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87e49f1-e83d-45f3-bafd-00c8d180f633 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:28.067005 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87e49f1-e83d-45f3-bafd-00c8d180f633 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:28.068087 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87e49f1-e83d-45f3-bafd-00c8d180f633 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:28.068751 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87e49f1-e83d-45f3-bafd-00c8d180f633 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:28.069233 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87e49f1-e83d-45f3-bafd-00c8d180f633 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:28.218431 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2e7edd3d-87b0-481d-b9d5-c009b8b2b069 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:28.219559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2e7edd3d-87b0-481d-b9d5-c009b8b2b069 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:28.237295 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e7edd3d-87b0-481d-b9d5-c009b8b2b069 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:28.238048 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e7edd3d-87b0-481d-b9d5-c009b8b2b069 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:28.238928 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e7edd3d-87b0-481d-b9d5-c009b8b2b069 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:28.240271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e7edd3d-87b0-481d-b9d5-c009b8b2b069 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:28.241236 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e7edd3d-87b0-481d-b9d5-c009b8b2b069 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:28.242097 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e7edd3d-87b0-481d-b9d5-c009b8b2b069 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:28.312264 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d87e49f1-e83d-45f3-bafd-00c8d180f633 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:28.330921 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d87e49f1-e83d-45f3-bafd-00c8d180f633 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.279868 Aug 24 08:56:28.331825 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 63/120] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:28 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:28.337956 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-889d721e-b50c-41d1-84b3-f637c2f7a44f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:28.339074 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-889d721e-b50c-41d1-84b3-f637c2f7a44f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:28.346593 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-889d721e-b50c-41d1-84b3-f637c2f7a44f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:28.347191 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-889d721e-b50c-41d1-84b3-f637c2f7a44f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:28.347709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-889d721e-b50c-41d1-84b3-f637c2f7a44f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:28.348674 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-889d721e-b50c-41d1-84b3-f637c2f7a44f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:28.350166 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-889d721e-b50c-41d1-84b3-f637c2f7a44f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:28.350803 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-889d721e-b50c-41d1-84b3-f637c2f7a44f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:28.582937 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2e7edd3d-87b0-481d-b9d5-c009b8b2b069 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:28.592610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2e7edd3d-87b0-481d-b9d5-c009b8b2b069 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:28.594399 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2e7edd3d-87b0-481d-b9d5-c009b8b2b069 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:28.595653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2e7edd3d-87b0-481d-b9d5-c009b8b2b069 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.386605 Aug 24 08:56:28.596488 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 58/121] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:28 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:28.640131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-889d721e-b50c-41d1-84b3-f637c2f7a44f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:28.649570 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-889d721e-b50c-41d1-84b3-f637c2f7a44f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.316497 Aug 24 08:56:28.650716 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 64/122] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:28 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:29.008994 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4f406c02-ad26-4537-bd3b-e4c741c88479 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:29.010482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4f406c02-ad26-4537-bd3b-e4c741c88479 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:29.038128 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f406c02-ad26-4537-bd3b-e4c741c88479 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:29.038950 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f406c02-ad26-4537-bd3b-e4c741c88479 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:29.039676 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f406c02-ad26-4537-bd3b-e4c741c88479 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:29.040970 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f406c02-ad26-4537-bd3b-e4c741c88479 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:29.041859 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f406c02-ad26-4537-bd3b-e4c741c88479 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:29.042467 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f406c02-ad26-4537-bd3b-e4c741c88479 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:29.045971 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6726b4be-42ee-4dd6-9823-874f6db43d7c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:29.046887 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6726b4be-42ee-4dd6-9823-874f6db43d7c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:29.051893 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:29.055734 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6726b4be-42ee-4dd6-9823-874f6db43d7c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:29.056402 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6726b4be-42ee-4dd6-9823-874f6db43d7c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:29.057003 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6726b4be-42ee-4dd6-9823-874f6db43d7c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:29.058018 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6726b4be-42ee-4dd6-9823-874f6db43d7c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:29.058634 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6726b4be-42ee-4dd6-9823-874f6db43d7c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:29.059234 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6726b4be-42ee-4dd6-9823-874f6db43d7c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:29.387044 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-6726b4be-42ee-4dd6-9823-874f6db43d7c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:29.397493 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-4f406c02-ad26-4537-bd3b-e4c741c88479 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:29.401303 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6726b4be-42ee-4dd6-9823-874f6db43d7c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.359336 Aug 24 08:56:29.402322 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 65/123] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:29 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:29.405656 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4f406c02-ad26-4537-bd3b-e4c741c88479 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.404639 Aug 24 08:56:29.406241 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 59/124] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:28 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:29.411816 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0e550b1c-9839-43eb-9931-c53950e8413d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:29.413170 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0e550b1c-9839-43eb-9931-c53950e8413d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:29.425725 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e550b1c-9839-43eb-9931-c53950e8413d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:29.426847 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e550b1c-9839-43eb-9931-c53950e8413d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:29.427762 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e550b1c-9839-43eb-9931-c53950e8413d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:29.429145 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e550b1c-9839-43eb-9931-c53950e8413d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:29.429979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e550b1c-9839-43eb-9931-c53950e8413d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:29.430760 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e550b1c-9839-43eb-9931-c53950e8413d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:29.448044 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:29.608907 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0e550b1c-9839-43eb-9931-c53950e8413d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:29.617481 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0e550b1c-9839-43eb-9931-c53950e8413d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.212930 Aug 24 08:56:29.620181 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 66/125] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:29 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:29.625732 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0fd1dcf8-8f58-4503-87e5-bc2babeeb0fe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:29.627309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0fd1dcf8-8f58-4503-87e5-bc2babeeb0fe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:29.638872 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fd1dcf8-8f58-4503-87e5-bc2babeeb0fe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:29.639510 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fd1dcf8-8f58-4503-87e5-bc2babeeb0fe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:29.640557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fd1dcf8-8f58-4503-87e5-bc2babeeb0fe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:29.641383 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fd1dcf8-8f58-4503-87e5-bc2babeeb0fe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:29.641937 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fd1dcf8-8f58-4503-87e5-bc2babeeb0fe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:29.643038 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0fd1dcf8-8f58-4503-87e5-bc2babeeb0fe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:29.670968 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-45d800cd-205f-4a0c-8af6-d4efcc848c13 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:29.671595 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-45d800cd-205f-4a0c-8af6-d4efcc848c13 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:29.678719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45d800cd-205f-4a0c-8af6-d4efcc848c13 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:29.679219 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45d800cd-205f-4a0c-8af6-d4efcc848c13 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:29.679664 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45d800cd-205f-4a0c-8af6-d4efcc848c13 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:29.680407 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45d800cd-205f-4a0c-8af6-d4efcc848c13 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:29.680859 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45d800cd-205f-4a0c-8af6-d4efcc848c13 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:29.682168 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-45d800cd-205f-4a0c-8af6-d4efcc848c13 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:30.063769 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0fd1dcf8-8f58-4503-87e5-bc2babeeb0fe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:30.072755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-45d800cd-205f-4a0c-8af6-d4efcc848c13 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:30.074920 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0fd1dcf8-8f58-4503-87e5-bc2babeeb0fe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:30.076612 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0fd1dcf8-8f58-4503-87e5-bc2babeeb0fe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:30.077766 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0fd1dcf8-8f58-4503-87e5-bc2babeeb0fe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.462092 Aug 24 08:56:30.078352 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 60/126] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:29 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:30.081231 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-45d800cd-205f-4a0c-8af6-d4efcc848c13 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.413925 Aug 24 08:56:30.081812 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 67/127] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:29 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:30.435120 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6aa2046a-3456-43a1-86fd-47adaf3abc22 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:30.436196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6aa2046a-3456-43a1-86fd-47adaf3abc22 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:30.442703 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-afff605b-ce35-4baf-9500-9e5a7c9bf6bc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:30.443719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-afff605b-ce35-4baf-9500-9e5a7c9bf6bc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:30.447356 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6aa2046a-3456-43a1-86fd-47adaf3abc22 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:30.448216 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6aa2046a-3456-43a1-86fd-47adaf3abc22 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:30.448862 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6aa2046a-3456-43a1-86fd-47adaf3abc22 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:30.449767 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6aa2046a-3456-43a1-86fd-47adaf3abc22 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:30.450293 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6aa2046a-3456-43a1-86fd-47adaf3abc22 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:30.450936 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6aa2046a-3456-43a1-86fd-47adaf3abc22 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:30.452257 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afff605b-ce35-4baf-9500-9e5a7c9bf6bc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:30.452818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afff605b-ce35-4baf-9500-9e5a7c9bf6bc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:30.453285 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afff605b-ce35-4baf-9500-9e5a7c9bf6bc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:30.454045 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afff605b-ce35-4baf-9500-9e5a7c9bf6bc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:30.454884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afff605b-ce35-4baf-9500-9e5a7c9bf6bc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:30.456200 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afff605b-ce35-4baf-9500-9e5a7c9bf6bc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:30.716083 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6aa2046a-3456-43a1-86fd-47adaf3abc22 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:30.726200 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6aa2046a-3456-43a1-86fd-47adaf3abc22 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.297185 Aug 24 08:56:30.729476 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-afff605b-ce35-4baf-9500-9e5a7c9bf6bc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:30.735771 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 61/128] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:30 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:30.747114 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2ccf4b1-26d0-40ba-b386-9ed5950db4c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:30.747940 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b2ccf4b1-26d0-40ba-b386-9ed5950db4c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:30.755663 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-afff605b-ce35-4baf-9500-9e5a7c9bf6bc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.319816 Aug 24 08:56:30.756663 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 68/129] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:30 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:30.761490 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2ccf4b1-26d0-40ba-b386-9ed5950db4c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:30.761998 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2ccf4b1-26d0-40ba-b386-9ed5950db4c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:30.762437 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2ccf4b1-26d0-40ba-b386-9ed5950db4c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:30.763162 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2ccf4b1-26d0-40ba-b386-9ed5950db4c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:30.763657 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2ccf4b1-26d0-40ba-b386-9ed5950db4c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:30.764283 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2ccf4b1-26d0-40ba-b386-9ed5950db4c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:30.951636 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b2ccf4b1-26d0-40ba-b386-9ed5950db4c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:30.962165 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b2ccf4b1-26d0-40ba-b386-9ed5950db4c6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.219764 Aug 24 08:56:30.962762 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 62/130] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:30 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:31.105200 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d1704959-3590-4c87-9970-d134dff16926 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:31.108281 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-285fcea8-2fbc-4e22-9f3c-0123d8320fb6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:31.109484 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d1704959-3590-4c87-9970-d134dff16926 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:31.112247 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-285fcea8-2fbc-4e22-9f3c-0123d8320fb6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:31.123013 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-285fcea8-2fbc-4e22-9f3c-0123d8320fb6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.125012 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1704959-3590-4c87-9970-d134dff16926 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.125851 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1704959-3590-4c87-9970-d134dff16926 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.126328 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1704959-3590-4c87-9970-d134dff16926 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:31.127678 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1704959-3590-4c87-9970-d134dff16926 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.128173 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1704959-3590-4c87-9970-d134dff16926 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.128610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1704959-3590-4c87-9970-d134dff16926 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:31.133272 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-285fcea8-2fbc-4e22-9f3c-0123d8320fb6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.133818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-285fcea8-2fbc-4e22-9f3c-0123d8320fb6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:31.134578 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-285fcea8-2fbc-4e22-9f3c-0123d8320fb6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.135047 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-285fcea8-2fbc-4e22-9f3c-0123d8320fb6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.135653 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-285fcea8-2fbc-4e22-9f3c-0123d8320fb6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:31.456433 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-285fcea8-2fbc-4e22-9f3c-0123d8320fb6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:31.461674 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d1704959-3590-4c87-9970-d134dff16926 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:31.474474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-285fcea8-2fbc-4e22-9f3c-0123d8320fb6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:31.477170 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d1704959-3590-4c87-9970-d134dff16926 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.375664 Aug 24 08:56:31.479215 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-285fcea8-2fbc-4e22-9f3c-0123d8320fb6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:31.480133 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 63/131] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:31 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:31.481304 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-285fcea8-2fbc-4e22-9f3c-0123d8320fb6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.383290 Aug 24 08:56:31.482179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 69/132] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:31 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:31.757822 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-48df38a8-aca2-47b0-a4cc-54404636b4ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:31.759667 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-48df38a8-aca2-47b0-a4cc-54404636b4ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:31.770513 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48df38a8-aca2-47b0-a4cc-54404636b4ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.771660 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48df38a8-aca2-47b0-a4cc-54404636b4ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.772460 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48df38a8-aca2-47b0-a4cc-54404636b4ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:31.774158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48df38a8-aca2-47b0-a4cc-54404636b4ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.775415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48df38a8-aca2-47b0-a4cc-54404636b4ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.775951 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48df38a8-aca2-47b0-a4cc-54404636b4ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:31.781620 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7e11c5ae-9934-4901-9153-8fb7a1a75948 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:31.782335 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7e11c5ae-9934-4901-9153-8fb7a1a75948 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:31.792378 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e11c5ae-9934-4901-9153-8fb7a1a75948 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.793046 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e11c5ae-9934-4901-9153-8fb7a1a75948 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.793492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e11c5ae-9934-4901-9153-8fb7a1a75948 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:31.794217 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e11c5ae-9934-4901-9153-8fb7a1a75948 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:31.794679 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e11c5ae-9934-4901-9153-8fb7a1a75948 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:31.795106 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e11c5ae-9934-4901-9153-8fb7a1a75948 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:32.024326 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-48df38a8-aca2-47b0-a4cc-54404636b4ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:32.029246 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7e11c5ae-9934-4901-9153-8fb7a1a75948 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:32.032702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-48df38a8-aca2-47b0-a4cc-54404636b4ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.283238 Aug 24 08:56:32.033331 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 64/133] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:31 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:32.038577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92b6e642-153f-4744-9143-d54aff6fa8b3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:32.039195 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-92b6e642-153f-4744-9143-d54aff6fa8b3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:32.044219 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7e11c5ae-9934-4901-9153-8fb7a1a75948 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.265991 Aug 24 08:56:32.045609 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 70/134] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:31 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:32.046253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92b6e642-153f-4744-9143-d54aff6fa8b3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:32.046823 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92b6e642-153f-4744-9143-d54aff6fa8b3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:32.047328 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92b6e642-153f-4744-9143-d54aff6fa8b3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:32.048172 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92b6e642-153f-4744-9143-d54aff6fa8b3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:32.049413 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92b6e642-153f-4744-9143-d54aff6fa8b3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:32.050281 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92b6e642-153f-4744-9143-d54aff6fa8b3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:32.199997 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-92b6e642-153f-4744-9143-d54aff6fa8b3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:32.208794 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-92b6e642-153f-4744-9143-d54aff6fa8b3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.174076 Aug 24 08:56:32.209390 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 65/135] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:32 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:32.502146 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7f04e4a-5926-4a34-b94f-98a0ef099230 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:32.503023 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e7f04e4a-5926-4a34-b94f-98a0ef099230 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:32.505347 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-12f62c9a-c14e-45df-a099-98c324a546fb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:32.505968 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-12f62c9a-c14e-45df-a099-98c324a546fb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:32.509098 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7f04e4a-5926-4a34-b94f-98a0ef099230 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:32.509590 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7f04e4a-5926-4a34-b94f-98a0ef099230 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:32.510023 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7f04e4a-5926-4a34-b94f-98a0ef099230 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:32.510739 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7f04e4a-5926-4a34-b94f-98a0ef099230 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:32.511193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7f04e4a-5926-4a34-b94f-98a0ef099230 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:32.511614 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7f04e4a-5926-4a34-b94f-98a0ef099230 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:32.514268 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12f62c9a-c14e-45df-a099-98c324a546fb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:32.515108 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12f62c9a-c14e-45df-a099-98c324a546fb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:32.515867 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12f62c9a-c14e-45df-a099-98c324a546fb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:32.517215 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12f62c9a-c14e-45df-a099-98c324a546fb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:32.518103 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12f62c9a-c14e-45df-a099-98c324a546fb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:32.518745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12f62c9a-c14e-45df-a099-98c324a546fb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:32.741336 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e7f04e4a-5926-4a34-b94f-98a0ef099230 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:32.755783 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7f04e4a-5926-4a34-b94f-98a0ef099230 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.258195 Aug 24 08:56:32.756862 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 71/136] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:32 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:32.764548 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-12f62c9a-c14e-45df-a099-98c324a546fb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:32.777156 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-12f62c9a-c14e-45df-a099-98c324a546fb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:32.780000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-12f62c9a-c14e-45df-a099-98c324a546fb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:32.781972 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-12f62c9a-c14e-45df-a099-98c324a546fb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.281144 Aug 24 08:56:32.782817 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 66/137] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:32 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:33.064111 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a1cb1f5a-74c5-4345-913b-66fd62e8071e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:33.065639 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a1cb1f5a-74c5-4345-913b-66fd62e8071e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:33.071906 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c91223cf-5a31-4661-98aa-0325908fc3b4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:33.072545 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1cb1f5a-74c5-4345-913b-66fd62e8071e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.072829 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c91223cf-5a31-4661-98aa-0325908fc3b4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:33.073020 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1cb1f5a-74c5-4345-913b-66fd62e8071e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.073446 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1cb1f5a-74c5-4345-913b-66fd62e8071e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.074311 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1cb1f5a-74c5-4345-913b-66fd62e8071e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.074935 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1cb1f5a-74c5-4345-913b-66fd62e8071e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.075352 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a1cb1f5a-74c5-4345-913b-66fd62e8071e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.098539 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c91223cf-5a31-4661-98aa-0325908fc3b4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.099044 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c91223cf-5a31-4661-98aa-0325908fc3b4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.099685 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c91223cf-5a31-4661-98aa-0325908fc3b4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.100926 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c91223cf-5a31-4661-98aa-0325908fc3b4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.101410 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c91223cf-5a31-4661-98aa-0325908fc3b4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.101853 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c91223cf-5a31-4661-98aa-0325908fc3b4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.392236 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a1cb1f5a-74c5-4345-913b-66fd62e8071e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:33.398540 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c91223cf-5a31-4661-98aa-0325908fc3b4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:33.401917 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a1cb1f5a-74c5-4345-913b-66fd62e8071e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.342472 Aug 24 08:56:33.402506 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 72/138] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:33 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:33.407317 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0c9d7251-dafa-44b0-9a4c-680162dcf1a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:33.407941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0c9d7251-dafa-44b0-9a4c-680162dcf1a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:33.411325 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c91223cf-5a31-4661-98aa-0325908fc3b4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.346247 Aug 24 08:56:33.412691 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 67/139] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:33 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:33.415629 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c9d7251-dafa-44b0-9a4c-680162dcf1a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.416547 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c9d7251-dafa-44b0-9a4c-680162dcf1a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.416710 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c9d7251-dafa-44b0-9a4c-680162dcf1a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.417305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c9d7251-dafa-44b0-9a4c-680162dcf1a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.417765 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c9d7251-dafa-44b0-9a4c-680162dcf1a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.418187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c9d7251-dafa-44b0-9a4c-680162dcf1a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.568822 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0c9d7251-dafa-44b0-9a4c-680162dcf1a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:33.576982 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0c9d7251-dafa-44b0-9a4c-680162dcf1a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.173414 Aug 24 08:56:33.577579 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 73/140] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:33 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:33.786784 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6d251d04-47e5-44f8-b48e-2c7994abe455 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:33.787407 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6d251d04-47e5-44f8-b48e-2c7994abe455 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:33.794052 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d251d04-47e5-44f8-b48e-2c7994abe455 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.794583 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d251d04-47e5-44f8-b48e-2c7994abe455 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.795022 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d251d04-47e5-44f8-b48e-2c7994abe455 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.795727 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d251d04-47e5-44f8-b48e-2c7994abe455 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.796219 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d251d04-47e5-44f8-b48e-2c7994abe455 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.796647 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6d251d04-47e5-44f8-b48e-2c7994abe455 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.819605 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9a56e3a4-1c0f-4ed8-bb4f-526d081f2851 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:33.820245 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9a56e3a4-1c0f-4ed8-bb4f-526d081f2851 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:33.826995 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a56e3a4-1c0f-4ed8-bb4f-526d081f2851 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.827568 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a56e3a4-1c0f-4ed8-bb4f-526d081f2851 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.828078 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a56e3a4-1c0f-4ed8-bb4f-526d081f2851 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:33.829014 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a56e3a4-1c0f-4ed8-bb4f-526d081f2851 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:33.829614 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a56e3a4-1c0f-4ed8-bb4f-526d081f2851 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:33.830603 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9a56e3a4-1c0f-4ed8-bb4f-526d081f2851 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:34.024828 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6d251d04-47e5-44f8-b48e-2c7994abe455 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:34.034748 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6d251d04-47e5-44f8-b48e-2c7994abe455 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.252495 Aug 24 08:56:34.035356 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 68/141] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:33 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:34.041513 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9a56e3a4-1c0f-4ed8-bb4f-526d081f2851 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:34.051582 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9a56e3a4-1c0f-4ed8-bb4f-526d081f2851 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:34.053167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9a56e3a4-1c0f-4ed8-bb4f-526d081f2851 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:34.054457 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9a56e3a4-1c0f-4ed8-bb4f-526d081f2851 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.239787 Aug 24 08:56:34.055030 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 74/142] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:33 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:34.425012 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ea746298-6e12-4579-b7eb-34c00b80cf38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:34.425785 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ea746298-6e12-4579-b7eb-34c00b80cf38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:34.432495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea746298-6e12-4579-b7eb-34c00b80cf38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:34.433011 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea746298-6e12-4579-b7eb-34c00b80cf38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:34.433450 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea746298-6e12-4579-b7eb-34c00b80cf38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:34.434183 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea746298-6e12-4579-b7eb-34c00b80cf38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:34.434818 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea746298-6e12-4579-b7eb-34c00b80cf38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:34.435159 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea746298-6e12-4579-b7eb-34c00b80cf38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:34.447492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a531f472-cf9a-4c5d-ac21-c03b5b4098b3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:34.448570 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a531f472-cf9a-4c5d-ac21-c03b5b4098b3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:34.460793 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a531f472-cf9a-4c5d-ac21-c03b5b4098b3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:34.462002 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a531f472-cf9a-4c5d-ac21-c03b5b4098b3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:34.462984 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a531f472-cf9a-4c5d-ac21-c03b5b4098b3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:34.464326 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a531f472-cf9a-4c5d-ac21-c03b5b4098b3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:34.465126 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a531f472-cf9a-4c5d-ac21-c03b5b4098b3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:34.465791 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a531f472-cf9a-4c5d-ac21-c03b5b4098b3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:34.730479 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ea746298-6e12-4579-b7eb-34c00b80cf38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:34.750521 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a531f472-cf9a-4c5d-ac21-c03b5b4098b3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:34.758243 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ea746298-6e12-4579-b7eb-34c00b80cf38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.338541 Aug 24 08:56:34.759764 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 69/143] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:34 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:34.767684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8e06d170-9e7d-47bd-8f9b-05bbe1d189cc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:34.769455 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8e06d170-9e7d-47bd-8f9b-05bbe1d189cc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:34.779366 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e06d170-9e7d-47bd-8f9b-05bbe1d189cc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:34.780332 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e06d170-9e7d-47bd-8f9b-05bbe1d189cc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:34.781192 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e06d170-9e7d-47bd-8f9b-05bbe1d189cc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:34.782273 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e06d170-9e7d-47bd-8f9b-05bbe1d189cc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:34.785198 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e06d170-9e7d-47bd-8f9b-05bbe1d189cc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:34.785198 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e06d170-9e7d-47bd-8f9b-05bbe1d189cc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:34.785649 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a531f472-cf9a-4c5d-ac21-c03b5b4098b3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.344460 Aug 24 08:56:34.785823 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 75/144] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:34 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:34.938261 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b1415cf3-7898-4058-b424-748afee59964 req-3152dce3-5e7c-4e1f-aeb5-d9da048004b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2489f27e-e91b-4e45-8072-7b4226f576f8", "name": "network-vif-plugged", "status": "completed", "tag": "f0b3f7af-883a-42f4-9c61-d5a909fd1e9a"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:34.954294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b1415cf3-7898-4058-b424-748afee59964 req-3152dce3-5e7c-4e1f-aeb5-d9da048004b1 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:34.955155 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b1415cf3-7898-4058-b424-748afee59964 req-3152dce3-5e7c-4e1f-aeb5-d9da048004b1 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:34.955948 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b1415cf3-7898-4058-b424-748afee59964 req-3152dce3-5e7c-4e1f-aeb5-d9da048004b1 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:34.978501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b1415cf3-7898-4058-b424-748afee59964 req-3152dce3-5e7c-4e1f-aeb5-d9da048004b1 service nova] Creating event network-vif-plugged:f0b3f7af-883a-42f4-9c61-d5a909fd1e9a for instance 2489f27e-e91b-4e45-8072-7b4226f576f8 on hv-cinder-83538 Aug 24 08:56:34.982551 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8e06d170-9e7d-47bd-8f9b-05bbe1d189cc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:34.987999 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b1415cf3-7898-4058-b424-748afee59964 req-3152dce3-5e7c-4e1f-aeb5-d9da048004b1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136178 Aug 24 08:56:34.989803 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 76/145] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:56:34.996085 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8e06d170-9e7d-47bd-8f9b-05bbe1d189cc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.234763 Aug 24 08:56:34.996730 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 70/146] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:34 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:35.057673 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8c9a6412-d91a-4541-a1ee-cd6c5b82cd99 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:35.058299 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8c9a6412-d91a-4541-a1ee-cd6c5b82cd99 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:35.065744 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9a6412-d91a-4541-a1ee-cd6c5b82cd99 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:35.066241 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9a6412-d91a-4541-a1ee-cd6c5b82cd99 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:35.066683 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9a6412-d91a-4541-a1ee-cd6c5b82cd99 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:35.067404 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9a6412-d91a-4541-a1ee-cd6c5b82cd99 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:35.067868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9a6412-d91a-4541-a1ee-cd6c5b82cd99 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:35.068331 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8c9a6412-d91a-4541-a1ee-cd6c5b82cd99 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:35.093630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d397e30e-1add-46b0-9028-bbc8daed9d6e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:35.094270 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d397e30e-1add-46b0-9028-bbc8daed9d6e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:35.101316 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d397e30e-1add-46b0-9028-bbc8daed9d6e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:35.101812 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d397e30e-1add-46b0-9028-bbc8daed9d6e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:35.102242 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d397e30e-1add-46b0-9028-bbc8daed9d6e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:35.102949 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d397e30e-1add-46b0-9028-bbc8daed9d6e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:35.103413 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d397e30e-1add-46b0-9028-bbc8daed9d6e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:35.103830 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d397e30e-1add-46b0-9028-bbc8daed9d6e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:35.308232 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8c9a6412-d91a-4541-a1ee-cd6c5b82cd99 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:35.318758 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d397e30e-1add-46b0-9028-bbc8daed9d6e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:35.321814 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8c9a6412-d91a-4541-a1ee-cd6c5b82cd99 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.269010 Aug 24 08:56:35.323288 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 77/147] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:35 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:35.329275 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d397e30e-1add-46b0-9028-bbc8daed9d6e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:35.331512 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d397e30e-1add-46b0-9028-bbc8daed9d6e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:35.332838 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d397e30e-1add-46b0-9028-bbc8daed9d6e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.243328 Aug 24 08:56:35.333494 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 71/148] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:35 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:35.790289 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fb387e0d-71db-495a-9b32-7bafd8369501 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:35.791090 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fb387e0d-71db-495a-9b32-7bafd8369501 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:35.797442 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb387e0d-71db-495a-9b32-7bafd8369501 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:35.797936 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb387e0d-71db-495a-9b32-7bafd8369501 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:35.798369 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb387e0d-71db-495a-9b32-7bafd8369501 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:35.799591 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb387e0d-71db-495a-9b32-7bafd8369501 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:35.800053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb387e0d-71db-495a-9b32-7bafd8369501 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:35.800500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fb387e0d-71db-495a-9b32-7bafd8369501 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:35.818591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-beecd9af-76cb-48bd-b347-4e6167daaa20 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:35.819203 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-beecd9af-76cb-48bd-b347-4e6167daaa20 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:35.825272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-beecd9af-76cb-48bd-b347-4e6167daaa20 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:35.825764 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-beecd9af-76cb-48bd-b347-4e6167daaa20 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:35.826190 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-beecd9af-76cb-48bd-b347-4e6167daaa20 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:35.826888 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-beecd9af-76cb-48bd-b347-4e6167daaa20 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:35.827334 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-beecd9af-76cb-48bd-b347-4e6167daaa20 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:35.827753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-beecd9af-76cb-48bd-b347-4e6167daaa20 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:36.053934 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-fb387e0d-71db-495a-9b32-7bafd8369501 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:36.071987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-beecd9af-76cb-48bd-b347-4e6167daaa20 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:36.073206 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fb387e0d-71db-495a-9b32-7bafd8369501 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.286661 Aug 24 08:56:36.074388 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 78/149] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:35 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:36.083162 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e1a4fcc6-34d2-4d8c-849d-4b892585be38 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:36.084042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e1a4fcc6-34d2-4d8c-849d-4b892585be38 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:36.091186 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-beecd9af-76cb-48bd-b347-4e6167daaa20 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.276952 Aug 24 08:56:36.091952 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1a4fcc6-34d2-4d8c-849d-4b892585be38 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:36.092127 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 72/150] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:35 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:36.092796 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1a4fcc6-34d2-4d8c-849d-4b892585be38 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:36.093293 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1a4fcc6-34d2-4d8c-849d-4b892585be38 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:36.094035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1a4fcc6-34d2-4d8c-849d-4b892585be38 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:36.094640 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1a4fcc6-34d2-4d8c-849d-4b892585be38 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:36.095241 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1a4fcc6-34d2-4d8c-849d-4b892585be38 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:36.286058 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e1a4fcc6-34d2-4d8c-849d-4b892585be38 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:36.300608 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e1a4fcc6-34d2-4d8c-849d-4b892585be38 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.224338 Aug 24 08:56:36.301752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 79/151] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:36 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:36.345384 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-67e409c8-8cb7-4ec7-81d5-32f082faefd3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:36.347845 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-67e409c8-8cb7-4ec7-81d5-32f082faefd3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:36.354985 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67e409c8-8cb7-4ec7-81d5-32f082faefd3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:36.355450 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67e409c8-8cb7-4ec7-81d5-32f082faefd3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:36.356278 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67e409c8-8cb7-4ec7-81d5-32f082faefd3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:36.357125 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67e409c8-8cb7-4ec7-81d5-32f082faefd3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:36.357693 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67e409c8-8cb7-4ec7-81d5-32f082faefd3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:36.358304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-67e409c8-8cb7-4ec7-81d5-32f082faefd3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:36.371154 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c4b271c2-06d5-431a-afdb-da4c1300e76b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:36.371948 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c4b271c2-06d5-431a-afdb-da4c1300e76b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:36.380846 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4b271c2-06d5-431a-afdb-da4c1300e76b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:36.381623 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4b271c2-06d5-431a-afdb-da4c1300e76b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:36.382333 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4b271c2-06d5-431a-afdb-da4c1300e76b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:36.383182 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4b271c2-06d5-431a-afdb-da4c1300e76b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:36.383757 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4b271c2-06d5-431a-afdb-da4c1300e76b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:36.384329 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4b271c2-06d5-431a-afdb-da4c1300e76b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:36.594733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-67e409c8-8cb7-4ec7-81d5-32f082faefd3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:36.605017 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-67e409c8-8cb7-4ec7-81d5-32f082faefd3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.263974 Aug 24 08:56:36.605647 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 73/152] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:36 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:36.606047 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4b271c2-06d5-431a-afdb-da4c1300e76b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:36.617521 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4b271c2-06d5-431a-afdb-da4c1300e76b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:36.619088 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4b271c2-06d5-431a-afdb-da4c1300e76b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:36.620353 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c4b271c2-06d5-431a-afdb-da4c1300e76b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.253752 Aug 24 08:56:36.621102 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 80/153] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:36 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:37.096621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6dce2ba8-8cbb-4d3a-832b-6c3ddb9edff4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:37.097653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6dce2ba8-8cbb-4d3a-832b-6c3ddb9edff4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:37.104449 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dce2ba8-8cbb-4d3a-832b-6c3ddb9edff4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.104953 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dce2ba8-8cbb-4d3a-832b-6c3ddb9edff4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.105398 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dce2ba8-8cbb-4d3a-832b-6c3ddb9edff4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.106204 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dce2ba8-8cbb-4d3a-832b-6c3ddb9edff4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.106666 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dce2ba8-8cbb-4d3a-832b-6c3ddb9edff4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.107104 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dce2ba8-8cbb-4d3a-832b-6c3ddb9edff4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.126869 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-923c00f6-769a-4d83-a7b6-135d47adc3c6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:37.128595 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-923c00f6-769a-4d83-a7b6-135d47adc3c6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:37.136592 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-923c00f6-769a-4d83-a7b6-135d47adc3c6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.141154 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-923c00f6-769a-4d83-a7b6-135d47adc3c6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.141986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-923c00f6-769a-4d83-a7b6-135d47adc3c6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.143811 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-923c00f6-769a-4d83-a7b6-135d47adc3c6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.144843 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-923c00f6-769a-4d83-a7b6-135d47adc3c6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.145774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-923c00f6-769a-4d83-a7b6-135d47adc3c6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.399214 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6dce2ba8-8cbb-4d3a-832b-6c3ddb9edff4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:37.408059 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6dce2ba8-8cbb-4d3a-832b-6c3ddb9edff4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.315530 Aug 24 08:56:37.410003 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 74/154] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:37 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:37.415710 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bee4079d-aacb-4d89-ae8c-00fce463f6c8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:37.416291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bee4079d-aacb-4d89-ae8c-00fce463f6c8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:37.428837 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bee4079d-aacb-4d89-ae8c-00fce463f6c8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.429709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bee4079d-aacb-4d89-ae8c-00fce463f6c8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.430411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bee4079d-aacb-4d89-ae8c-00fce463f6c8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.432201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bee4079d-aacb-4d89-ae8c-00fce463f6c8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.433064 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bee4079d-aacb-4d89-ae8c-00fce463f6c8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.433823 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bee4079d-aacb-4d89-ae8c-00fce463f6c8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.463415 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-923c00f6-769a-4d83-a7b6-135d47adc3c6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:37.487131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-923c00f6-769a-4d83-a7b6-135d47adc3c6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.363278 Aug 24 08:56:37.490628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 81/155] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:37 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:37.641296 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-48102ed5-e4e3-48a8-817c-3ee3a3d28720 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:37.641976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-48102ed5-e4e3-48a8-817c-3ee3a3d28720 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:37.645892 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-bee4079d-aacb-4d89-ae8c-00fce463f6c8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:37.655768 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48102ed5-e4e3-48a8-817c-3ee3a3d28720 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.656408 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48102ed5-e4e3-48a8-817c-3ee3a3d28720 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.656920 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48102ed5-e4e3-48a8-817c-3ee3a3d28720 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.657364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:37.657796 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48102ed5-e4e3-48a8-817c-3ee3a3d28720 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.661256 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48102ed5-e4e3-48a8-817c-3ee3a3d28720 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.665140 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48102ed5-e4e3-48a8-817c-3ee3a3d28720 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.668394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bee4079d-aacb-4d89-ae8c-00fce463f6c8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.257024 Aug 24 08:56:37.670843 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 75/156] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:37 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:37.684908 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6c86036c-922e-4b6b-8788-3199ab1d63b0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:37.686596 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6c86036c-922e-4b6b-8788-3199ab1d63b0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:37.695037 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c86036c-922e-4b6b-8788-3199ab1d63b0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.695982 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c86036c-922e-4b6b-8788-3199ab1d63b0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.696422 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c86036c-922e-4b6b-8788-3199ab1d63b0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.699158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c86036c-922e-4b6b-8788-3199ab1d63b0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:37.699158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c86036c-922e-4b6b-8788-3199ab1d63b0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:37.699158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c86036c-922e-4b6b-8788-3199ab1d63b0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:37.888320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-48102ed5-e4e3-48a8-817c-3ee3a3d28720 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:37.897053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-48102ed5-e4e3-48a8-817c-3ee3a3d28720 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.260958 Aug 24 08:56:37.897644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 82/157] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:37 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:37.962023 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6c86036c-922e-4b6b-8788-3199ab1d63b0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:37.973312 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6c86036c-922e-4b6b-8788-3199ab1d63b0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:37.974894 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6c86036c-922e-4b6b-8788-3199ab1d63b0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:37.976056 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6c86036c-922e-4b6b-8788-3199ab1d63b0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.303631 Aug 24 08:56:37.976688 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 76/158] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:37 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:38.450277 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-184d2668-55a7-4999-b043-dd45d813f8dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:38.454214 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-184d2668-55a7-4999-b043-dd45d813f8dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:38.483015 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-184d2668-55a7-4999-b043-dd45d813f8dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:38.488348 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-184d2668-55a7-4999-b043-dd45d813f8dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:38.490224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-184d2668-55a7-4999-b043-dd45d813f8dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:38.493547 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-184d2668-55a7-4999-b043-dd45d813f8dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:38.495252 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-184d2668-55a7-4999-b043-dd45d813f8dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:38.496127 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-184d2668-55a7-4999-b043-dd45d813f8dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:38.518686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b95b0093-5d49-42f2-88f8-5e9862dd533b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:38.522745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b95b0093-5d49-42f2-88f8-5e9862dd533b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:38.549398 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=91 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:38.562081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b95b0093-5d49-42f2-88f8-5e9862dd533b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:38.565269 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b95b0093-5d49-42f2-88f8-5e9862dd533b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:38.566797 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b95b0093-5d49-42f2-88f8-5e9862dd533b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:38.572132 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b95b0093-5d49-42f2-88f8-5e9862dd533b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:38.574638 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b95b0093-5d49-42f2-88f8-5e9862dd533b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:38.575893 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b95b0093-5d49-42f2-88f8-5e9862dd533b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:38.875922 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-184d2668-55a7-4999-b043-dd45d813f8dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:38.880944 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:38.895481 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-184d2668-55a7-4999-b043-dd45d813f8dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.455292 Aug 24 08:56:38.896764 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 83/159] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:38 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:38.906512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a901bd9a-8420-476e-b6ba-a5bdf3772517 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:38.908168 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a901bd9a-8420-476e-b6ba-a5bdf3772517 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:38.913121 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:38.924834 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a901bd9a-8420-476e-b6ba-a5bdf3772517 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:38.926156 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a901bd9a-8420-476e-b6ba-a5bdf3772517 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:38.927248 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a901bd9a-8420-476e-b6ba-a5bdf3772517 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:38.929030 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a901bd9a-8420-476e-b6ba-a5bdf3772517 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:38.930741 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a901bd9a-8420-476e-b6ba-a5bdf3772517 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:38.931819 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a901bd9a-8420-476e-b6ba-a5bdf3772517 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:38.983651 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b95b0093-5d49-42f2-88f8-5e9862dd533b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:39.004961 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b95b0093-5d49-42f2-88f8-5e9862dd533b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.493066 Aug 24 08:56:39.015575 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 77/160] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:38 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:39.015575 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2f1dc56e-7e20-459b-b7c4-b04f48829c96 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:39.016670 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2f1dc56e-7e20-459b-b7c4-b04f48829c96 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:39.028113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f1dc56e-7e20-459b-b7c4-b04f48829c96 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:39.028755 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f1dc56e-7e20-459b-b7c4-b04f48829c96 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:39.029278 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f1dc56e-7e20-459b-b7c4-b04f48829c96 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:39.030228 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f1dc56e-7e20-459b-b7c4-b04f48829c96 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:39.030765 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f1dc56e-7e20-459b-b7c4-b04f48829c96 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:39.031297 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f1dc56e-7e20-459b-b7c4-b04f48829c96 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:39.238535 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a901bd9a-8420-476e-b6ba-a5bdf3772517 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:39.255281 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a901bd9a-8420-476e-b6ba-a5bdf3772517 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.353830 Aug 24 08:56:39.257560 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 84/161] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:38 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:39.260135 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2f1dc56e-7e20-459b-b7c4-b04f48829c96 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:39.270055 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-13f62164-1d6f-4c42-87f6-452c987ee8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:39.270707 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-13f62164-1d6f-4c42-87f6-452c987ee8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:39.278615 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13f62164-1d6f-4c42-87f6-452c987ee8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:39.279073 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13f62164-1d6f-4c42-87f6-452c987ee8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:39.279503 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13f62164-1d6f-4c42-87f6-452c987ee8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:39.280242 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13f62164-1d6f-4c42-87f6-452c987ee8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:39.280697 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13f62164-1d6f-4c42-87f6-452c987ee8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:39.281122 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13f62164-1d6f-4c42-87f6-452c987ee8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:39.283701 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2f1dc56e-7e20-459b-b7c4-b04f48829c96 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.275766 Aug 24 08:56:39.285099 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 78/162] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:39 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:39.450363 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-13f62164-1d6f-4c42-87f6-452c987ee8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:39.460710 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-13f62164-1d6f-4c42-87f6-452c987ee8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:39.462230 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-13f62164-1d6f-4c42-87f6-452c987ee8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:39.463369 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-13f62164-1d6f-4c42-87f6-452c987ee8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.200326 Aug 24 08:56:39.463942 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 85/163] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:39 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:39.924973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6feb22e7-6d82-4742-b93e-07b9f2c49c54 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:39.925576 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6feb22e7-6d82-4742-b93e-07b9f2c49c54 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:39.932018 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6feb22e7-6d82-4742-b93e-07b9f2c49c54 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:39.932557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6feb22e7-6d82-4742-b93e-07b9f2c49c54 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:39.932986 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6feb22e7-6d82-4742-b93e-07b9f2c49c54 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:39.933705 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6feb22e7-6d82-4742-b93e-07b9f2c49c54 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:39.934161 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6feb22e7-6d82-4742-b93e-07b9f2c49c54 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:39.934588 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6feb22e7-6d82-4742-b93e-07b9f2c49c54 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:40.048351 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-93ea1ea0-6c87-41e4-ab7d-9eb16f721a71 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:40.050083 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-93ea1ea0-6c87-41e4-ab7d-9eb16f721a71 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:40.061268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93ea1ea0-6c87-41e4-ab7d-9eb16f721a71 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:40.061836 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93ea1ea0-6c87-41e4-ab7d-9eb16f721a71 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:40.062370 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93ea1ea0-6c87-41e4-ab7d-9eb16f721a71 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:40.063165 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93ea1ea0-6c87-41e4-ab7d-9eb16f721a71 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:40.063625 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93ea1ea0-6c87-41e4-ab7d-9eb16f721a71 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:40.064046 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93ea1ea0-6c87-41e4-ab7d-9eb16f721a71 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:40.098863 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6feb22e7-6d82-4742-b93e-07b9f2c49c54 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:40.110313 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6feb22e7-6d82-4742-b93e-07b9f2c49c54 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.191673 Aug 24 08:56:40.116132 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 79/164] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:39 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:40.216727 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-93ea1ea0-6c87-41e4-ab7d-9eb16f721a71 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:40.225837 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-93ea1ea0-6c87-41e4-ab7d-9eb16f721a71 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.184976 Aug 24 08:56:40.226477 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 86/165] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:40 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:40.278089 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-01c9a865-76ab-46f9-bdbc-ae4697fd3d30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:40.278619 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-01c9a865-76ab-46f9-bdbc-ae4697fd3d30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:40.285482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01c9a865-76ab-46f9-bdbc-ae4697fd3d30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:40.285979 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01c9a865-76ab-46f9-bdbc-ae4697fd3d30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:40.286418 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01c9a865-76ab-46f9-bdbc-ae4697fd3d30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:40.287131 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01c9a865-76ab-46f9-bdbc-ae4697fd3d30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:40.287593 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01c9a865-76ab-46f9-bdbc-ae4697fd3d30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:40.288021 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01c9a865-76ab-46f9-bdbc-ae4697fd3d30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:40.319191 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ae0c67f0-d619-4d62-861e-a8c5e87674d8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:40.320218 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ae0c67f0-d619-4d62-861e-a8c5e87674d8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:40.331546 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae0c67f0-d619-4d62-861e-a8c5e87674d8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:40.332423 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae0c67f0-d619-4d62-861e-a8c5e87674d8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:40.333197 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae0c67f0-d619-4d62-861e-a8c5e87674d8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:40.334447 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae0c67f0-d619-4d62-861e-a8c5e87674d8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:40.335273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae0c67f0-d619-4d62-861e-a8c5e87674d8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:40.336052 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae0c67f0-d619-4d62-861e-a8c5e87674d8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:40.524124 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-01c9a865-76ab-46f9-bdbc-ae4697fd3d30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:40.534971 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-01c9a865-76ab-46f9-bdbc-ae4697fd3d30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.259806 Aug 24 08:56:40.535725 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 80/166] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:40 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:40.542748 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b9ca47e-523f-4183-bdd5-c2da6d14271d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:40.544044 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1b9ca47e-523f-4183-bdd5-c2da6d14271d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:40.556910 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b9ca47e-523f-4183-bdd5-c2da6d14271d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:40.557959 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b9ca47e-523f-4183-bdd5-c2da6d14271d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:40.558821 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b9ca47e-523f-4183-bdd5-c2da6d14271d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:40.564590 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b9ca47e-523f-4183-bdd5-c2da6d14271d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:40.565734 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b9ca47e-523f-4183-bdd5-c2da6d14271d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:40.566185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b9ca47e-523f-4183-bdd5-c2da6d14271d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:40.567510 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ae0c67f0-d619-4d62-861e-a8c5e87674d8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:40.582324 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ae0c67f0-d619-4d62-861e-a8c5e87674d8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.267542 Aug 24 08:56:40.583192 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 87/167] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:40 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:40.729714 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b9ca47e-523f-4183-bdd5-c2da6d14271d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:40.741348 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b9ca47e-523f-4183-bdd5-c2da6d14271d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:40.743063 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b9ca47e-523f-4183-bdd5-c2da6d14271d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:40.744492 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1b9ca47e-523f-4183-bdd5-c2da6d14271d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.207077 Aug 24 08:56:40.745110 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 81/168] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:40 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:41.138724 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-020763a4-df0f-4c7b-8626-bb814b6ef190 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:41.139350 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-020763a4-df0f-4c7b-8626-bb814b6ef190 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:41.145970 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-020763a4-df0f-4c7b-8626-bb814b6ef190 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.146455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-020763a4-df0f-4c7b-8626-bb814b6ef190 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.146894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-020763a4-df0f-4c7b-8626-bb814b6ef190 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.147622 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-020763a4-df0f-4c7b-8626-bb814b6ef190 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.148075 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-020763a4-df0f-4c7b-8626-bb814b6ef190 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.148544 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-020763a4-df0f-4c7b-8626-bb814b6ef190 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.248457 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-29981376-ea47-4257-bb9b-ac2a47d28c27 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:41.249272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-29981376-ea47-4257-bb9b-ac2a47d28c27 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:41.259079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29981376-ea47-4257-bb9b-ac2a47d28c27 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.259973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29981376-ea47-4257-bb9b-ac2a47d28c27 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.260811 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29981376-ea47-4257-bb9b-ac2a47d28c27 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.262137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29981376-ea47-4257-bb9b-ac2a47d28c27 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.263003 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29981376-ea47-4257-bb9b-ac2a47d28c27 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.263795 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29981376-ea47-4257-bb9b-ac2a47d28c27 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.303060 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-020763a4-df0f-4c7b-8626-bb814b6ef190 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:41.311265 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-020763a4-df0f-4c7b-8626-bb814b6ef190 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.176513 Aug 24 08:56:41.311869 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 88/169] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:41 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:41.456156 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-29981376-ea47-4257-bb9b-ac2a47d28c27 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:41.470048 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-29981376-ea47-4257-bb9b-ac2a47d28c27 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.225133 Aug 24 08:56:41.471141 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 82/170] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:41 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:41.569007 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-23c7d6cd-72d0-43fc-9b83-066ff87be1ae tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:41.569618 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-23c7d6cd-72d0-43fc-9b83-066ff87be1ae tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:41.575852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23c7d6cd-72d0-43fc-9b83-066ff87be1ae tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.576377 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23c7d6cd-72d0-43fc-9b83-066ff87be1ae tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.576816 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23c7d6cd-72d0-43fc-9b83-066ff87be1ae tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.577517 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23c7d6cd-72d0-43fc-9b83-066ff87be1ae tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.577972 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23c7d6cd-72d0-43fc-9b83-066ff87be1ae tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.578399 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23c7d6cd-72d0-43fc-9b83-066ff87be1ae tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.617475 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-09bb0756-4ab7-452c-9b34-4a6fdbaafa75 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:41.618571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-09bb0756-4ab7-452c-9b34-4a6fdbaafa75 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:41.626706 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09bb0756-4ab7-452c-9b34-4a6fdbaafa75 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.627937 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09bb0756-4ab7-452c-9b34-4a6fdbaafa75 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.629267 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09bb0756-4ab7-452c-9b34-4a6fdbaafa75 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.630270 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09bb0756-4ab7-452c-9b34-4a6fdbaafa75 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.630735 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09bb0756-4ab7-452c-9b34-4a6fdbaafa75 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.631161 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09bb0756-4ab7-452c-9b34-4a6fdbaafa75 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.821993 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-23c7d6cd-72d0-43fc-9b83-066ff87be1ae tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:41.830436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-23c7d6cd-72d0-43fc-9b83-066ff87be1ae tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.265955 Aug 24 08:56:41.831098 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 89/171] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:41 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:41.847336 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b5335aab-13f8-4774-90ce-213da520350c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:41.848466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b5335aab-13f8-4774-90ce-213da520350c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:41.859334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5335aab-13f8-4774-90ce-213da520350c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.859910 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5335aab-13f8-4774-90ce-213da520350c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.860465 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5335aab-13f8-4774-90ce-213da520350c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.861270 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5335aab-13f8-4774-90ce-213da520350c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:41.862466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5335aab-13f8-4774-90ce-213da520350c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:41.863327 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5335aab-13f8-4774-90ce-213da520350c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:41.866241 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-09bb0756-4ab7-452c-9b34-4a6fdbaafa75 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:41.874647 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-09bb0756-4ab7-452c-9b34-4a6fdbaafa75 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.266645 Aug 24 08:56:41.875403 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 83/172] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:41 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:42.018811 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b5335aab-13f8-4774-90ce-213da520350c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:42.025716 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b5335aab-13f8-4774-90ce-213da520350c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:42.027255 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b5335aab-13f8-4774-90ce-213da520350c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:42.028441 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b5335aab-13f8-4774-90ce-213da520350c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.187641 Aug 24 08:56:42.029013 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 90/173] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:41 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:42.334568 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c7c8f7a4-2c5b-4f5a-b062-6175e13b2f93 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:42.335397 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c7c8f7a4-2c5b-4f5a-b062-6175e13b2f93 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:42.342483 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7c8f7a4-2c5b-4f5a-b062-6175e13b2f93 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:42.343018 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7c8f7a4-2c5b-4f5a-b062-6175e13b2f93 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:42.343592 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7c8f7a4-2c5b-4f5a-b062-6175e13b2f93 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:42.344524 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7c8f7a4-2c5b-4f5a-b062-6175e13b2f93 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:42.345046 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7c8f7a4-2c5b-4f5a-b062-6175e13b2f93 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:42.345639 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c7c8f7a4-2c5b-4f5a-b062-6175e13b2f93 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:42.495151 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6474ecf2-6a4e-44a8-93d5-dc70d705d57a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:42.496599 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6474ecf2-6a4e-44a8-93d5-dc70d705d57a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:42.505322 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6474ecf2-6a4e-44a8-93d5-dc70d705d57a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:42.506264 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6474ecf2-6a4e-44a8-93d5-dc70d705d57a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:42.506961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6474ecf2-6a4e-44a8-93d5-dc70d705d57a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:42.507857 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6474ecf2-6a4e-44a8-93d5-dc70d705d57a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:42.508552 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6474ecf2-6a4e-44a8-93d5-dc70d705d57a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:42.509340 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6474ecf2-6a4e-44a8-93d5-dc70d705d57a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:42.531023 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c7c8f7a4-2c5b-4f5a-b062-6175e13b2f93 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:42.542839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c7c8f7a4-2c5b-4f5a-b062-6175e13b2f93 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.213516 Aug 24 08:56:42.543773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 84/174] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:42 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:42.681732 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-6474ecf2-6a4e-44a8-93d5-dc70d705d57a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:42.690713 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6474ecf2-6a4e-44a8-93d5-dc70d705d57a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.202700 Aug 24 08:56:42.691312 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 91/175] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:42 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:42.854323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d5bd6361-346f-421e-883f-61643153a430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:42.855820 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d5bd6361-346f-421e-883f-61643153a430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:42.865145 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5bd6361-346f-421e-883f-61643153a430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:42.865656 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5bd6361-346f-421e-883f-61643153a430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:42.866087 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5bd6361-346f-421e-883f-61643153a430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:42.866891 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5bd6361-346f-421e-883f-61643153a430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:42.867443 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5bd6361-346f-421e-883f-61643153a430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:42.867900 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5bd6361-346f-421e-883f-61643153a430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:42.901920 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c652ecca-7aa5-43d1-a7b8-44eee7c3be6b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:42.902535 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c652ecca-7aa5-43d1-a7b8-44eee7c3be6b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:42.911339 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c652ecca-7aa5-43d1-a7b8-44eee7c3be6b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:42.912254 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c652ecca-7aa5-43d1-a7b8-44eee7c3be6b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:42.913030 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c652ecca-7aa5-43d1-a7b8-44eee7c3be6b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:42.914256 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c652ecca-7aa5-43d1-a7b8-44eee7c3be6b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:42.915086 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c652ecca-7aa5-43d1-a7b8-44eee7c3be6b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:42.915820 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c652ecca-7aa5-43d1-a7b8-44eee7c3be6b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:43.129256 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d5bd6361-346f-421e-883f-61643153a430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:43.145518 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d5bd6361-346f-421e-883f-61643153a430 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.297320 Aug 24 08:56:43.146748 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 85/176] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:42 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:43.159878 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c652ecca-7aa5-43d1-a7b8-44eee7c3be6b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:43.160166 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ffefdc89-7161-4958-9de5-d8e6bea12bb5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:43.160307 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c652ecca-7aa5-43d1-a7b8-44eee7c3be6b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.260062 Aug 24 08:56:43.160445 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ffefdc89-7161-4958-9de5-d8e6bea12bb5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:43.168624 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 92/177] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:42 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:43.171277 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffefdc89-7161-4958-9de5-d8e6bea12bb5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:43.172440 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffefdc89-7161-4958-9de5-d8e6bea12bb5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:43.173424 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffefdc89-7161-4958-9de5-d8e6bea12bb5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:43.175362 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffefdc89-7161-4958-9de5-d8e6bea12bb5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:43.176283 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffefdc89-7161-4958-9de5-d8e6bea12bb5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:43.177085 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffefdc89-7161-4958-9de5-d8e6bea12bb5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:43.353291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ffefdc89-7161-4958-9de5-d8e6bea12bb5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:43.364223 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ffefdc89-7161-4958-9de5-d8e6bea12bb5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:43.366074 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ffefdc89-7161-4958-9de5-d8e6bea12bb5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:43.367266 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ffefdc89-7161-4958-9de5-d8e6bea12bb5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.218906 Aug 24 08:56:43.368129 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 86/178] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:43 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:43.577444 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7a450321-5a16-4067-b822-bf180fa67e6b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:43.578094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7a450321-5a16-4067-b822-bf180fa67e6b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:43.584917 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a450321-5a16-4067-b822-bf180fa67e6b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:43.585416 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a450321-5a16-4067-b822-bf180fa67e6b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:43.585859 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a450321-5a16-4067-b822-bf180fa67e6b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:43.586582 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a450321-5a16-4067-b822-bf180fa67e6b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:43.587041 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a450321-5a16-4067-b822-bf180fa67e6b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:43.587469 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a450321-5a16-4067-b822-bf180fa67e6b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:43.711280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fd0d791c-57c7-476f-b20c-a9df8b56dea0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:43.711897 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fd0d791c-57c7-476f-b20c-a9df8b56dea0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:43.720797 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd0d791c-57c7-476f-b20c-a9df8b56dea0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:43.723253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd0d791c-57c7-476f-b20c-a9df8b56dea0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:43.723907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd0d791c-57c7-476f-b20c-a9df8b56dea0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:43.725447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd0d791c-57c7-476f-b20c-a9df8b56dea0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:43.726404 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd0d791c-57c7-476f-b20c-a9df8b56dea0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:43.727374 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd0d791c-57c7-476f-b20c-a9df8b56dea0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:43.759117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7a450321-5a16-4067-b822-bf180fa67e6b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:43.768216 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7a450321-5a16-4067-b822-bf180fa67e6b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.194536 Aug 24 08:56:43.769338 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 93/179] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:43 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:43.902893 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-fd0d791c-57c7-476f-b20c-a9df8b56dea0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:43.912240 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fd0d791c-57c7-476f-b20c-a9df8b56dea0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.204715 Aug 24 08:56:43.913085 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 87/180] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:43 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:44.167404 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7977b647-a166-4c64-afe5-7e5fc64d9945 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:44.168335 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7977b647-a166-4c64-afe5-7e5fc64d9945 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:44.179116 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7977b647-a166-4c64-afe5-7e5fc64d9945 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.179995 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7977b647-a166-4c64-afe5-7e5fc64d9945 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.180800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7977b647-a166-4c64-afe5-7e5fc64d9945 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.181332 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-018f27fb-5775-4fce-8ef1-f6f45f7faac1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:44.181564 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7977b647-a166-4c64-afe5-7e5fc64d9945 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.181963 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-018f27fb-5775-4fce-8ef1-f6f45f7faac1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:44.182071 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7977b647-a166-4c64-afe5-7e5fc64d9945 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.182462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7977b647-a166-4c64-afe5-7e5fc64d9945 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.188500 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-018f27fb-5775-4fce-8ef1-f6f45f7faac1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.189006 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-018f27fb-5775-4fce-8ef1-f6f45f7faac1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.189444 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-018f27fb-5775-4fce-8ef1-f6f45f7faac1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.192059 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-018f27fb-5775-4fce-8ef1-f6f45f7faac1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.192059 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-018f27fb-5775-4fce-8ef1-f6f45f7faac1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.192059 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-018f27fb-5775-4fce-8ef1-f6f45f7faac1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.586445 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7977b647-a166-4c64-afe5-7e5fc64d9945 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:44.594381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-018f27fb-5775-4fce-8ef1-f6f45f7faac1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:44.595261 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7977b647-a166-4c64-afe5-7e5fc64d9945 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.431208 Aug 24 08:56:44.595261 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 94/181] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:44 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:44.599974 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d939049d-34cf-4b51-a94d-99ebfdd94bd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:44.600634 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d939049d-34cf-4b51-a94d-99ebfdd94bd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:44.607925 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d939049d-34cf-4b51-a94d-99ebfdd94bd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.608232 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-018f27fb-5775-4fce-8ef1-f6f45f7faac1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.429170 Aug 24 08:56:44.608396 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d939049d-34cf-4b51-a94d-99ebfdd94bd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.608396 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d939049d-34cf-4b51-a94d-99ebfdd94bd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.608839 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d939049d-34cf-4b51-a94d-99ebfdd94bd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.609301 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d939049d-34cf-4b51-a94d-99ebfdd94bd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.609733 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d939049d-34cf-4b51-a94d-99ebfdd94bd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.615384 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 88/182] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:44 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:44.769780 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d939049d-34cf-4b51-a94d-99ebfdd94bd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:44.779470 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d939049d-34cf-4b51-a94d-99ebfdd94bd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:44.781080 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d939049d-34cf-4b51-a94d-99ebfdd94bd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:44.782245 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d939049d-34cf-4b51-a94d-99ebfdd94bd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.186164 Aug 24 08:56:44.782985 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 95/183] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:44 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:44.793883 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ea758a0e-1a6b-41b6-8834-35bfc4d97a71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:44.794496 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ea758a0e-1a6b-41b6-8834-35bfc4d97a71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:44.801805 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea758a0e-1a6b-41b6-8834-35bfc4d97a71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.802295 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea758a0e-1a6b-41b6-8834-35bfc4d97a71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.802734 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea758a0e-1a6b-41b6-8834-35bfc4d97a71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.803441 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea758a0e-1a6b-41b6-8834-35bfc4d97a71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.803899 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea758a0e-1a6b-41b6-8834-35bfc4d97a71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.804349 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea758a0e-1a6b-41b6-8834-35bfc4d97a71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.940738 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a00820fb-db69-4694-a55f-7f003a0371fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:44.941776 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a00820fb-db69-4694-a55f-7f003a0371fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:44.948378 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a00820fb-db69-4694-a55f-7f003a0371fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.948876 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a00820fb-db69-4694-a55f-7f003a0371fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.949312 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a00820fb-db69-4694-a55f-7f003a0371fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.950022 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a00820fb-db69-4694-a55f-7f003a0371fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:44.950480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a00820fb-db69-4694-a55f-7f003a0371fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:44.950905 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a00820fb-db69-4694-a55f-7f003a0371fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:44.994526 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ea758a0e-1a6b-41b6-8834-35bfc4d97a71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:45.011249 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ea758a0e-1a6b-41b6-8834-35bfc4d97a71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.219111 Aug 24 08:56:45.016531 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 89/184] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:44 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:45.132716 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a00820fb-db69-4694-a55f-7f003a0371fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:45.144782 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a00820fb-db69-4694-a55f-7f003a0371fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.210202 Aug 24 08:56:45.145668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 96/185] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:44 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:45.617574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6351dacf-b572-4def-94b4-758dfb4d50d8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:45.618123 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6351dacf-b572-4def-94b4-758dfb4d50d8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:45.625548 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6351dacf-b572-4def-94b4-758dfb4d50d8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:45.626061 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6351dacf-b572-4def-94b4-758dfb4d50d8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:45.626511 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6351dacf-b572-4def-94b4-758dfb4d50d8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:45.627249 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6351dacf-b572-4def-94b4-758dfb4d50d8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:45.627747 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6351dacf-b572-4def-94b4-758dfb4d50d8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:45.628211 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6351dacf-b572-4def-94b4-758dfb4d50d8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:45.631820 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-76d42b73-252b-4e23-a5fc-211b92019bef tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:45.632835 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-76d42b73-252b-4e23-a5fc-211b92019bef tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:45.644390 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76d42b73-252b-4e23-a5fc-211b92019bef tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:45.645483 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76d42b73-252b-4e23-a5fc-211b92019bef tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:45.646344 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76d42b73-252b-4e23-a5fc-211b92019bef tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:45.647612 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76d42b73-252b-4e23-a5fc-211b92019bef tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:45.648472 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76d42b73-252b-4e23-a5fc-211b92019bef tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:45.649236 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-76d42b73-252b-4e23-a5fc-211b92019bef tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:46.724268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-76d42b73-252b-4e23-a5fc-211b92019bef tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:46.743793 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-76d42b73-252b-4e23-a5fc-211b92019bef tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 1.114985 Aug 24 08:56:46.744712 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 97/186] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:45 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:46.749173 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6351dacf-b572-4def-94b4-758dfb4d50d8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:46.764625 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6351dacf-b572-4def-94b4-758dfb4d50d8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 1.150911 Aug 24 08:56:46.781263 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c271469c-e14f-4984-89e7-d6889b83ac46 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:46.782621 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c271469c-e14f-4984-89e7-d6889b83ac46 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:46.795455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c271469c-e14f-4984-89e7-d6889b83ac46 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:46.797583 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c271469c-e14f-4984-89e7-d6889b83ac46 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:46.800462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c271469c-e14f-4984-89e7-d6889b83ac46 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:46.802626 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c271469c-e14f-4984-89e7-d6889b83ac46 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:46.805553 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c271469c-e14f-4984-89e7-d6889b83ac46 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:46.806874 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c271469c-e14f-4984-89e7-d6889b83ac46 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:46.822372 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 90/187] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:45 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:46.853173 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a4fd5abc-aa86-4686-8a3c-da4827508cd8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:46.854342 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a4fd5abc-aa86-4686-8a3c-da4827508cd8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:46.908214 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4fd5abc-aa86-4686-8a3c-da4827508cd8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:46.911036 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4fd5abc-aa86-4686-8a3c-da4827508cd8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:46.911672 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4fd5abc-aa86-4686-8a3c-da4827508cd8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:46.913590 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4fd5abc-aa86-4686-8a3c-da4827508cd8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:46.914279 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4fd5abc-aa86-4686-8a3c-da4827508cd8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:46.914927 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4fd5abc-aa86-4686-8a3c-da4827508cd8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:47.462686 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c271469c-e14f-4984-89e7-d6889b83ac46 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:47.501302 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c271469c-e14f-4984-89e7-d6889b83ac46 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:47.510585 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c271469c-e14f-4984-89e7-d6889b83ac46 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:47.512431 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c271469c-e14f-4984-89e7-d6889b83ac46 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.754546 Aug 24 08:56:47.513537 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 98/188] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:46 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:47.516727 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a4fd5abc-aa86-4686-8a3c-da4827508cd8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:47.527520 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a4fd5abc-aa86-4686-8a3c-da4827508cd8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.702943 Aug 24 08:56:47.532434 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 91/189] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:46 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:47.532559 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-43e3c81f-05a5-4415-b510-71a8cb282e84 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:47.532559 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-43e3c81f-05a5-4415-b510-71a8cb282e84 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:47.536475 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-667189e7-ca2f-4a24-8dcf-8dc56e8a51b7 req-3defa2a6-95bc-4b45-9efe-61e01ac64801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6cadaae-8d3b-485a-87a8-cdf9b320b2b8", "name": "network-vif-plugged", "status": "completed", "tag": "997e8c94-fb8c-46c5-848a-11eb858266eb"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:47.540355 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43e3c81f-05a5-4415-b510-71a8cb282e84 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:47.540944 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43e3c81f-05a5-4415-b510-71a8cb282e84 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:47.541451 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43e3c81f-05a5-4415-b510-71a8cb282e84 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:47.542249 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43e3c81f-05a5-4415-b510-71a8cb282e84 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:47.542741 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43e3c81f-05a5-4415-b510-71a8cb282e84 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:47.543173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-43e3c81f-05a5-4415-b510-71a8cb282e84 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:47.551568 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-667189e7-ca2f-4a24-8dcf-8dc56e8a51b7 req-3defa2a6-95bc-4b45-9efe-61e01ac64801 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:47.552064 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-667189e7-ca2f-4a24-8dcf-8dc56e8a51b7 req-3defa2a6-95bc-4b45-9efe-61e01ac64801 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:47.552523 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-667189e7-ca2f-4a24-8dcf-8dc56e8a51b7 req-3defa2a6-95bc-4b45-9efe-61e01ac64801 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:47.567204 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-667189e7-ca2f-4a24-8dcf-8dc56e8a51b7 req-3defa2a6-95bc-4b45-9efe-61e01ac64801 service nova] Creating event network-vif-plugged:997e8c94-fb8c-46c5-848a-11eb858266eb for instance d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 on hv-cinder-83538 Aug 24 08:56:47.575658 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-667189e7-ca2f-4a24-8dcf-8dc56e8a51b7 req-3defa2a6-95bc-4b45-9efe-61e01ac64801 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045147 Aug 24 08:56:47.577096 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 92/190] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:47.697001 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-43e3c81f-05a5-4415-b510-71a8cb282e84 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:47.705015 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-43e3c81f-05a5-4415-b510-71a8cb282e84 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.189944 Aug 24 08:56:47.705603 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 99/191] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:47 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:47.774589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7e82dcce-4d5b-4cd0-89ae-c4bf9c173290 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:47.775376 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7e82dcce-4d5b-4cd0-89ae-c4bf9c173290 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:47.782719 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e82dcce-4d5b-4cd0-89ae-c4bf9c173290 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:47.782989 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e82dcce-4d5b-4cd0-89ae-c4bf9c173290 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:47.783906 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e82dcce-4d5b-4cd0-89ae-c4bf9c173290 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:47.785669 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e82dcce-4d5b-4cd0-89ae-c4bf9c173290 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:47.786147 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e82dcce-4d5b-4cd0-89ae-c4bf9c173290 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:47.786581 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7e82dcce-4d5b-4cd0-89ae-c4bf9c173290 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:47.789809 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d778ebd9-4736-414b-8988-db585033d100 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:47.790377 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:47.790476 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d778ebd9-4736-414b-8988-db585033d100 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:47.809037 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d778ebd9-4736-414b-8988-db585033d100 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:47.809805 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d778ebd9-4736-414b-8988-db585033d100 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:47.810304 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d778ebd9-4736-414b-8988-db585033d100 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:47.813772 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d778ebd9-4736-414b-8988-db585033d100 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:47.813772 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d778ebd9-4736-414b-8988-db585033d100 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:47.813772 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d778ebd9-4736-414b-8988-db585033d100 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:47.838146 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:48.064601 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7e82dcce-4d5b-4cd0-89ae-c4bf9c173290 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:48.070911 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d778ebd9-4736-414b-8988-db585033d100 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:48.084604 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d778ebd9-4736-414b-8988-db585033d100 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.299159 Aug 24 08:56:48.100512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 100/192] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:47 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:48.107963 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7e82dcce-4d5b-4cd0-89ae-c4bf9c173290 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.335885 Aug 24 08:56:48.108706 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 93/193] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:47 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:48.541787 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-de62bd29-3203-4dfd-91e2-73810e6a2423 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:48.542662 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-de62bd29-3203-4dfd-91e2-73810e6a2423 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:48.549726 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de62bd29-3203-4dfd-91e2-73810e6a2423 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:48.550482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de62bd29-3203-4dfd-91e2-73810e6a2423 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:48.551228 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de62bd29-3203-4dfd-91e2-73810e6a2423 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:48.551946 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de62bd29-3203-4dfd-91e2-73810e6a2423 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:48.552427 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de62bd29-3203-4dfd-91e2-73810e6a2423 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:48.552851 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-de62bd29-3203-4dfd-91e2-73810e6a2423 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:48.559325 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9e2952d8-ebba-4dac-a70c-ef5dbd2316b6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:48.560242 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9e2952d8-ebba-4dac-a70c-ef5dbd2316b6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:48.568225 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e2952d8-ebba-4dac-a70c-ef5dbd2316b6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:48.568566 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e2952d8-ebba-4dac-a70c-ef5dbd2316b6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:48.569056 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e2952d8-ebba-4dac-a70c-ef5dbd2316b6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:48.569987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e2952d8-ebba-4dac-a70c-ef5dbd2316b6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:48.570693 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e2952d8-ebba-4dac-a70c-ef5dbd2316b6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:48.571343 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e2952d8-ebba-4dac-a70c-ef5dbd2316b6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:48.809435 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-de62bd29-3203-4dfd-91e2-73810e6a2423 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:48.816128 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9e2952d8-ebba-4dac-a70c-ef5dbd2316b6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:48.819381 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-de62bd29-3203-4dfd-91e2-73810e6a2423 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:48.821139 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-de62bd29-3203-4dfd-91e2-73810e6a2423 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:48.822479 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-de62bd29-3203-4dfd-91e2-73810e6a2423 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.286758 Aug 24 08:56:48.823031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 101/194] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:48 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:48.825091 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9e2952d8-ebba-4dac-a70c-ef5dbd2316b6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.270001 Aug 24 08:56:48.827976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-05f4e92c-b89c-44e5-8e8f-f87aa19597cc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:48.828791 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-05f4e92c-b89c-44e5-8e8f-f87aa19597cc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:48.836476 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05f4e92c-b89c-44e5-8e8f-f87aa19597cc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:48.837195 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05f4e92c-b89c-44e5-8e8f-f87aa19597cc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:48.837807 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05f4e92c-b89c-44e5-8e8f-f87aa19597cc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:48.838661 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05f4e92c-b89c-44e5-8e8f-f87aa19597cc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:48.839262 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05f4e92c-b89c-44e5-8e8f-f87aa19597cc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:48.839989 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 94/195] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:48 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:48.840500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05f4e92c-b89c-44e5-8e8f-f87aa19597cc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:49.050853 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-05f4e92c-b89c-44e5-8e8f-f87aa19597cc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:49.059127 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-05f4e92c-b89c-44e5-8e8f-f87aa19597cc tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.234843 Aug 24 08:56:49.060131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 102/196] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:48 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:49.116255 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-15579f0c-ec6b-4bd1-9ed2-e5bedc257787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:49.117118 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-15579f0c-ec6b-4bd1-9ed2-e5bedc257787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:49.125124 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15579f0c-ec6b-4bd1-9ed2-e5bedc257787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:49.127913 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15579f0c-ec6b-4bd1-9ed2-e5bedc257787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:49.128787 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15579f0c-ec6b-4bd1-9ed2-e5bedc257787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:49.129945 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15579f0c-ec6b-4bd1-9ed2-e5bedc257787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:49.130419 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15579f0c-ec6b-4bd1-9ed2-e5bedc257787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:49.130847 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-15579f0c-ec6b-4bd1-9ed2-e5bedc257787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:49.134144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-811c2afe-3a8f-4281-bd6f-38bc334d3026 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:49.135333 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-811c2afe-3a8f-4281-bd6f-38bc334d3026 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:49.143812 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-811c2afe-3a8f-4281-bd6f-38bc334d3026 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:49.144811 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-811c2afe-3a8f-4281-bd6f-38bc334d3026 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:49.145420 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-811c2afe-3a8f-4281-bd6f-38bc334d3026 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:49.146312 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-811c2afe-3a8f-4281-bd6f-38bc334d3026 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:49.146914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-811c2afe-3a8f-4281-bd6f-38bc334d3026 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:49.147494 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-811c2afe-3a8f-4281-bd6f-38bc334d3026 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:49.444701 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-15579f0c-ec6b-4bd1-9ed2-e5bedc257787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:49.454679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-15579f0c-ec6b-4bd1-9ed2-e5bedc257787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.343669 Aug 24 08:56:49.455294 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 95/197] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:49 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:49.475371 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-811c2afe-3a8f-4281-bd6f-38bc334d3026 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:49.485343 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-811c2afe-3a8f-4281-bd6f-38bc334d3026 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.356374 Aug 24 08:56:49.485955 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 103/198] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:49 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:49.849267 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7c0be139-071a-4055-b3b3-99a207211105 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:49.850318 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7c0be139-071a-4055-b3b3-99a207211105 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:49.852484 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-457f5d79-6704-4122-ad0a-d5ee1e42e6f4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:49.853741 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-457f5d79-6704-4122-ad0a-d5ee1e42e6f4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:49.857153 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c0be139-071a-4055-b3b3-99a207211105 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:49.857647 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c0be139-071a-4055-b3b3-99a207211105 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:49.858344 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c0be139-071a-4055-b3b3-99a207211105 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:49.859080 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c0be139-071a-4055-b3b3-99a207211105 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:49.859534 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c0be139-071a-4055-b3b3-99a207211105 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:49.860570 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7c0be139-071a-4055-b3b3-99a207211105 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:49.862511 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-457f5d79-6704-4122-ad0a-d5ee1e42e6f4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:49.863063 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-457f5d79-6704-4122-ad0a-d5ee1e42e6f4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:49.864179 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-457f5d79-6704-4122-ad0a-d5ee1e42e6f4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:49.865125 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-457f5d79-6704-4122-ad0a-d5ee1e42e6f4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:49.866002 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-457f5d79-6704-4122-ad0a-d5ee1e42e6f4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:49.866637 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-457f5d79-6704-4122-ad0a-d5ee1e42e6f4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:50.332729 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-457f5d79-6704-4122-ad0a-d5ee1e42e6f4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:50.345811 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7c0be139-071a-4055-b3b3-99a207211105 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:50.349839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-457f5d79-6704-4122-ad0a-d5ee1e42e6f4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.504342 Aug 24 08:56:50.350729 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 96/199] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:49 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:50.355583 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7c0be139-071a-4055-b3b3-99a207211105 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:50.357355 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7c0be139-071a-4055-b3b3-99a207211105 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:50.358709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7c0be139-071a-4055-b3b3-99a207211105 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.514567 Aug 24 08:56:50.359517 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7661a743-25f7-45b7-aab3-66195a1240f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:50.359635 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 104/200] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:49 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:50.360332 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7661a743-25f7-45b7-aab3-66195a1240f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:50.368690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7661a743-25f7-45b7-aab3-66195a1240f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:50.369186 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7661a743-25f7-45b7-aab3-66195a1240f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:50.369624 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7661a743-25f7-45b7-aab3-66195a1240f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:50.370339 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7661a743-25f7-45b7-aab3-66195a1240f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:50.370792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7661a743-25f7-45b7-aab3-66195a1240f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:50.371212 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7661a743-25f7-45b7-aab3-66195a1240f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:50.479973 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2a4949fe-1b64-4641-8df3-1532cbeb036b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:50.481397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2a4949fe-1b64-4641-8df3-1532cbeb036b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:50.492877 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a4949fe-1b64-4641-8df3-1532cbeb036b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:50.493822 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a4949fe-1b64-4641-8df3-1532cbeb036b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:50.494496 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a4949fe-1b64-4641-8df3-1532cbeb036b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:50.495535 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a4949fe-1b64-4641-8df3-1532cbeb036b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:50.496323 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a4949fe-1b64-4641-8df3-1532cbeb036b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:50.497006 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a4949fe-1b64-4641-8df3-1532cbeb036b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:50.541533 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7661a743-25f7-45b7-aab3-66195a1240f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:50.551753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7661a743-25f7-45b7-aab3-66195a1240f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.199793 Aug 24 08:56:50.553054 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 97/201] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:50 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:50.561470 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eab27f3d-6569-48d7-b725-148b176cdf8d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:50.562444 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eab27f3d-6569-48d7-b725-148b176cdf8d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:50.570160 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab27f3d-6569-48d7-b725-148b176cdf8d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:50.571092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab27f3d-6569-48d7-b725-148b176cdf8d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:50.571714 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab27f3d-6569-48d7-b725-148b176cdf8d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:50.572760 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab27f3d-6569-48d7-b725-148b176cdf8d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:50.573333 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab27f3d-6569-48d7-b725-148b176cdf8d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:50.573882 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab27f3d-6569-48d7-b725-148b176cdf8d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:50.703753 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-2a4949fe-1b64-4641-8df3-1532cbeb036b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:50.712655 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2a4949fe-1b64-4641-8df3-1532cbeb036b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.238532 Aug 24 08:56:50.713240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 105/202] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:50 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:50.773158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-eab27f3d-6569-48d7-b725-148b176cdf8d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:50.786212 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eab27f3d-6569-48d7-b725-148b176cdf8d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.231528 Aug 24 08:56:50.786875 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 98/203] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:50 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:51.372979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9431d085-f968-4674-baf7-9cd71a4f8120 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:51.373493 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9431d085-f968-4674-baf7-9cd71a4f8120 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:51.380279 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9431d085-f968-4674-baf7-9cd71a4f8120 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.380775 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9431d085-f968-4674-baf7-9cd71a4f8120 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.381214 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9431d085-f968-4674-baf7-9cd71a4f8120 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.381926 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9431d085-f968-4674-baf7-9cd71a4f8120 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.382375 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9431d085-f968-4674-baf7-9cd71a4f8120 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.382810 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9431d085-f968-4674-baf7-9cd71a4f8120 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.383253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-30a1d38a-5aa6-4920-8b0f-18efa4c6347c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:51.383870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-30a1d38a-5aa6-4920-8b0f-18efa4c6347c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:51.390662 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30a1d38a-5aa6-4920-8b0f-18efa4c6347c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.391158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30a1d38a-5aa6-4920-8b0f-18efa4c6347c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.391598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30a1d38a-5aa6-4920-8b0f-18efa4c6347c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.392361 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30a1d38a-5aa6-4920-8b0f-18efa4c6347c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.392819 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30a1d38a-5aa6-4920-8b0f-18efa4c6347c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.393242 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-30a1d38a-5aa6-4920-8b0f-18efa4c6347c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.598519 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9431d085-f968-4674-baf7-9cd71a4f8120 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:51.607032 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9431d085-f968-4674-baf7-9cd71a4f8120 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.237892 Aug 24 08:56:51.607321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-30a1d38a-5aa6-4920-8b0f-18efa4c6347c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:51.607745 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 106/204] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:51 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:51.612653 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7c1918a-982c-4557-bc12-2f6d21db76be tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:51.613269 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e7c1918a-982c-4557-bc12-2f6d21db76be tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:51.619624 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-30a1d38a-5aa6-4920-8b0f-18efa4c6347c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:51.620197 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7c1918a-982c-4557-bc12-2f6d21db76be tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.620700 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7c1918a-982c-4557-bc12-2f6d21db76be tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.621139 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7c1918a-982c-4557-bc12-2f6d21db76be tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.621867 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7c1918a-982c-4557-bc12-2f6d21db76be tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.622363 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7c1918a-982c-4557-bc12-2f6d21db76be tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.622463 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-30a1d38a-5aa6-4920-8b0f-18efa4c6347c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:51.622803 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7c1918a-982c-4557-bc12-2f6d21db76be tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.623845 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-30a1d38a-5aa6-4920-8b0f-18efa4c6347c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.245620 Aug 24 08:56:51.624385 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 99/205] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:51 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:51.739444 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-69322264-515e-4b9e-a171-17377bcf712d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:51.740083 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-69322264-515e-4b9e-a171-17377bcf712d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:51.746878 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69322264-515e-4b9e-a171-17377bcf712d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.747384 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69322264-515e-4b9e-a171-17377bcf712d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.747825 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69322264-515e-4b9e-a171-17377bcf712d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.748594 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69322264-515e-4b9e-a171-17377bcf712d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.749044 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69322264-515e-4b9e-a171-17377bcf712d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.749480 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69322264-515e-4b9e-a171-17377bcf712d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.778477 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e7c1918a-982c-4557-bc12-2f6d21db76be tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:51.787357 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7c1918a-982c-4557-bc12-2f6d21db76be tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.178596 Aug 24 08:56:51.787942 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 107/206] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:51 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:51.806915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-defccddf-3b0d-4f83-a039-d38533bb5482 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:51.807524 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-defccddf-3b0d-4f83-a039-d38533bb5482 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:51.813807 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-defccddf-3b0d-4f83-a039-d38533bb5482 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.814307 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-defccddf-3b0d-4f83-a039-d38533bb5482 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.814739 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-defccddf-3b0d-4f83-a039-d38533bb5482 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.815465 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-defccddf-3b0d-4f83-a039-d38533bb5482 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:51.815925 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-defccddf-3b0d-4f83-a039-d38533bb5482 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:51.816369 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-defccddf-3b0d-4f83-a039-d38533bb5482 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:51.943351 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-69322264-515e-4b9e-a171-17377bcf712d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:51.951561 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-69322264-515e-4b9e-a171-17377bcf712d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.216482 Aug 24 08:56:51.952179 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 100/207] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:51 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:51.982232 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-defccddf-3b0d-4f83-a039-d38533bb5482 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:51.991208 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-defccddf-3b0d-4f83-a039-d38533bb5482 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.187823 Aug 24 08:56:51.991795 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 108/208] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:51 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:52.631279 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9e95cb7c-6f30-47d5-8510-ff680f1073f6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:52.631902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9e95cb7c-6f30-47d5-8510-ff680f1073f6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:52.638113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e95cb7c-6f30-47d5-8510-ff680f1073f6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:52.638594 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e95cb7c-6f30-47d5-8510-ff680f1073f6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:52.639024 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e95cb7c-6f30-47d5-8510-ff680f1073f6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:52.639714 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e95cb7c-6f30-47d5-8510-ff680f1073f6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:52.640197 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e95cb7c-6f30-47d5-8510-ff680f1073f6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:52.640620 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e95cb7c-6f30-47d5-8510-ff680f1073f6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:52.648213 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3693c555-3d44-44c4-ab6b-a49120342565 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:52.648821 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3693c555-3d44-44c4-ab6b-a49120342565 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:52.654907 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3693c555-3d44-44c4-ab6b-a49120342565 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:52.655381 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3693c555-3d44-44c4-ab6b-a49120342565 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:52.655813 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3693c555-3d44-44c4-ab6b-a49120342565 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:52.656544 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3693c555-3d44-44c4-ab6b-a49120342565 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:52.656999 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3693c555-3d44-44c4-ab6b-a49120342565 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:52.657427 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3693c555-3d44-44c4-ab6b-a49120342565 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:52.856938 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9e95cb7c-6f30-47d5-8510-ff680f1073f6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:52.866947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3693c555-3d44-44c4-ab6b-a49120342565 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:52.867249 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9e95cb7c-6f30-47d5-8510-ff680f1073f6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.239858 Aug 24 08:56:52.876489 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 101/209] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:52 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:52.876489 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b72850eb-1c91-42d1-89ee-331629cbd029 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:52.876489 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b72850eb-1c91-42d1-89ee-331629cbd029 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:52.880615 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b72850eb-1c91-42d1-89ee-331629cbd029 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:52.880982 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b72850eb-1c91-42d1-89ee-331629cbd029 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:52.881485 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b72850eb-1c91-42d1-89ee-331629cbd029 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:52.882266 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b72850eb-1c91-42d1-89ee-331629cbd029 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:52.882794 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b72850eb-1c91-42d1-89ee-331629cbd029 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:52.883289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b72850eb-1c91-42d1-89ee-331629cbd029 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:52.886124 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3693c555-3d44-44c4-ab6b-a49120342565 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:52.899015 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3693c555-3d44-44c4-ab6b-a49120342565 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:52.901998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3693c555-3d44-44c4-ab6b-a49120342565 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.258049 Aug 24 08:56:52.907721 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 109/210] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:52 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:52.974624 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0cba5a6e-2ec2-4494-be82-c25938e3af07 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:52.975242 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0cba5a6e-2ec2-4494-be82-c25938e3af07 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:52.981689 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cba5a6e-2ec2-4494-be82-c25938e3af07 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:52.982187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cba5a6e-2ec2-4494-be82-c25938e3af07 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:52.982623 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cba5a6e-2ec2-4494-be82-c25938e3af07 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:52.983343 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cba5a6e-2ec2-4494-be82-c25938e3af07 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:52.983804 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cba5a6e-2ec2-4494-be82-c25938e3af07 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:52.984341 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0cba5a6e-2ec2-4494-be82-c25938e3af07 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:53.043535 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b72850eb-1c91-42d1-89ee-331629cbd029 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:53.052623 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b72850eb-1c91-42d1-89ee-331629cbd029 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.183350 Aug 24 08:56:53.053204 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 102/211] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:52 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:53.058176 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-05d3fde9-7dac-4e44-8d04-9d2df7f2cb66 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:53.058863 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-05d3fde9-7dac-4e44-8d04-9d2df7f2cb66 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:53.065438 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05d3fde9-7dac-4e44-8d04-9d2df7f2cb66 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:53.066427 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05d3fde9-7dac-4e44-8d04-9d2df7f2cb66 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:53.066854 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05d3fde9-7dac-4e44-8d04-9d2df7f2cb66 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:53.067549 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05d3fde9-7dac-4e44-8d04-9d2df7f2cb66 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:53.068000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05d3fde9-7dac-4e44-8d04-9d2df7f2cb66 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:53.068445 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-05d3fde9-7dac-4e44-8d04-9d2df7f2cb66 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:53.261370 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0cba5a6e-2ec2-4494-be82-c25938e3af07 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:53.271525 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0cba5a6e-2ec2-4494-be82-c25938e3af07 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.301477 Aug 24 08:56:53.272358 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 110/212] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:52 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:53.325719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-3dd073ef-77e1-42c5-9d7b-4b0baee13748 req-5de8d2c3-da1d-439f-b8e5-21bd8f8903f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9fe4277-954f-428e-8652-af3bbf1f0977", "name": "network-vif-plugged", "status": "completed", "tag": "11b3a920-2e8c-4bc1-beec-00dad8bb96b6"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:56:53.342260 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3dd073ef-77e1-42c5-9d7b-4b0baee13748 req-5de8d2c3-da1d-439f-b8e5-21bd8f8903f2 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:53.342754 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3dd073ef-77e1-42c5-9d7b-4b0baee13748 req-5de8d2c3-da1d-439f-b8e5-21bd8f8903f2 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:53.343195 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3dd073ef-77e1-42c5-9d7b-4b0baee13748 req-5de8d2c3-da1d-439f-b8e5-21bd8f8903f2 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:53.356425 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-05d3fde9-7dac-4e44-8d04-9d2df7f2cb66 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:53.370982 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-3dd073ef-77e1-42c5-9d7b-4b0baee13748 req-5de8d2c3-da1d-439f-b8e5-21bd8f8903f2 service nova] Creating event network-vif-plugged:11b3a920-2e8c-4bc1-beec-00dad8bb96b6 for instance f9fe4277-954f-428e-8652-af3bbf1f0977 on hv-cinder-83538 Aug 24 08:56:53.383517 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-3dd073ef-77e1-42c5-9d7b-4b0baee13748 req-5de8d2c3-da1d-439f-b8e5-21bd8f8903f2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071940 Aug 24 08:56:53.384166 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 111/213] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:56:53.390054 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-05d3fde9-7dac-4e44-8d04-9d2df7f2cb66 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.334959 Aug 24 08:56:53.391929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 103/214] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:53 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:53.901310 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8ef5b194-8e2a-4c40-953c-6d949e8fc8b0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:53.901965 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8ef5b194-8e2a-4c40-953c-6d949e8fc8b0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:53.908299 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef5b194-8e2a-4c40-953c-6d949e8fc8b0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:53.908784 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef5b194-8e2a-4c40-953c-6d949e8fc8b0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:53.909348 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef5b194-8e2a-4c40-953c-6d949e8fc8b0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:53.910167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef5b194-8e2a-4c40-953c-6d949e8fc8b0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:53.910628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef5b194-8e2a-4c40-953c-6d949e8fc8b0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:53.911053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ef5b194-8e2a-4c40-953c-6d949e8fc8b0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:53.924640 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-799a73d5-5be4-4541-8168-3679867cbf59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:53.925756 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-799a73d5-5be4-4541-8168-3679867cbf59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:53.934314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-799a73d5-5be4-4541-8168-3679867cbf59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:53.934898 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-799a73d5-5be4-4541-8168-3679867cbf59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:53.935386 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-799a73d5-5be4-4541-8168-3679867cbf59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:53.936546 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-799a73d5-5be4-4541-8168-3679867cbf59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:53.937160 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-799a73d5-5be4-4541-8168-3679867cbf59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:53.937776 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-799a73d5-5be4-4541-8168-3679867cbf59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:54.122434 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8ef5b194-8e2a-4c40-953c-6d949e8fc8b0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:54.124611 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-799a73d5-5be4-4541-8168-3679867cbf59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:54.131414 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8ef5b194-8e2a-4c40-953c-6d949e8fc8b0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.234397 Aug 24 08:56:54.134957 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 112/215] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:53 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:54.136597 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-799a73d5-5be4-4541-8168-3679867cbf59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:54.136844 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9f007997-c0f5-44b6-a046-231937532748 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:54.137446 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9f007997-c0f5-44b6-a046-231937532748 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:54.139035 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-799a73d5-5be4-4541-8168-3679867cbf59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:54.140771 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-799a73d5-5be4-4541-8168-3679867cbf59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.219888 Aug 24 08:56:54.144892 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f007997-c0f5-44b6-a046-231937532748 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:54.146636 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f007997-c0f5-44b6-a046-231937532748 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:54.147488 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f007997-c0f5-44b6-a046-231937532748 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:54.148731 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f007997-c0f5-44b6-a046-231937532748 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:54.149538 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f007997-c0f5-44b6-a046-231937532748 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:54.150052 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9f007997-c0f5-44b6-a046-231937532748 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:54.153483 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 104/216] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:53 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:54.293099 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9f007997-c0f5-44b6-a046-231937532748 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:54.293266 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b9eed301-4cb7-4a53-9abb-96cfd01558e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:54.293854 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b9eed301-4cb7-4a53-9abb-96cfd01558e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:54.302956 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9eed301-4cb7-4a53-9abb-96cfd01558e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:54.303769 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9eed301-4cb7-4a53-9abb-96cfd01558e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:54.304591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9eed301-4cb7-4a53-9abb-96cfd01558e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:54.304738 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9f007997-c0f5-44b6-a046-231937532748 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.171333 Aug 24 08:56:54.305931 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 113/217] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:54 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:54.306082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9eed301-4cb7-4a53-9abb-96cfd01558e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:54.306799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9eed301-4cb7-4a53-9abb-96cfd01558e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:54.307626 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b9eed301-4cb7-4a53-9abb-96cfd01558e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:54.413233 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c5d8b27a-d294-4474-9d4f-7d4c93874bc1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:54.413741 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c5d8b27a-d294-4474-9d4f-7d4c93874bc1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:54.420530 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5d8b27a-d294-4474-9d4f-7d4c93874bc1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:54.421026 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5d8b27a-d294-4474-9d4f-7d4c93874bc1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:54.421467 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5d8b27a-d294-4474-9d4f-7d4c93874bc1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:54.422181 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5d8b27a-d294-4474-9d4f-7d4c93874bc1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:54.422643 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5d8b27a-d294-4474-9d4f-7d4c93874bc1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:54.423069 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5d8b27a-d294-4474-9d4f-7d4c93874bc1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:54.466738 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b9eed301-4cb7-4a53-9abb-96cfd01558e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:54.480840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b9eed301-4cb7-4a53-9abb-96cfd01558e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.191285 Aug 24 08:56:54.481912 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 105/218] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:54 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:54.603785 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c5d8b27a-d294-4474-9d4f-7d4c93874bc1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:54.617176 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c5d8b27a-d294-4474-9d4f-7d4c93874bc1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.207991 Aug 24 08:56:54.618144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 114/219] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:54 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:55.154136 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57b8b516-63ab-4d28-a06e-f8af9ec12e68 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:55.154736 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-57b8b516-63ab-4d28-a06e-f8af9ec12e68 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:55.161825 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57b8b516-63ab-4d28-a06e-f8af9ec12e68 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:55.162312 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57b8b516-63ab-4d28-a06e-f8af9ec12e68 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:55.162743 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57b8b516-63ab-4d28-a06e-f8af9ec12e68 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:55.163432 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57b8b516-63ab-4d28-a06e-f8af9ec12e68 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:55.163881 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57b8b516-63ab-4d28-a06e-f8af9ec12e68 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:55.164333 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57b8b516-63ab-4d28-a06e-f8af9ec12e68 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:55.164886 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-007133ba-6adb-4495-8c8e-a2c94fb63580 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:55.165591 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-007133ba-6adb-4495-8c8e-a2c94fb63580 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:55.171696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-007133ba-6adb-4495-8c8e-a2c94fb63580 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:55.172314 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-007133ba-6adb-4495-8c8e-a2c94fb63580 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:55.172642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-007133ba-6adb-4495-8c8e-a2c94fb63580 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:55.173341 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-007133ba-6adb-4495-8c8e-a2c94fb63580 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:55.173792 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-007133ba-6adb-4495-8c8e-a2c94fb63580 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:55.174219 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-007133ba-6adb-4495-8c8e-a2c94fb63580 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:55.388565 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-57b8b516-63ab-4d28-a06e-f8af9ec12e68 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:55.397302 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-57b8b516-63ab-4d28-a06e-f8af9ec12e68 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.246915 Aug 24 08:56:55.398001 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 106/220] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:55 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:55.401289 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-007133ba-6adb-4495-8c8e-a2c94fb63580 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:55.406450 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a2c277e2-f59d-4d3c-b21e-aa48fa7c9a59 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:55.406995 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a2c277e2-f59d-4d3c-b21e-aa48fa7c9a59 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:55.411294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-007133ba-6adb-4495-8c8e-a2c94fb63580 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:55.412912 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-007133ba-6adb-4495-8c8e-a2c94fb63580 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:55.414083 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-007133ba-6adb-4495-8c8e-a2c94fb63580 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.253141 Aug 24 08:56:55.414551 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2c277e2-f59d-4d3c-b21e-aa48fa7c9a59 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:55.414733 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 115/221] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:55 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:55.415052 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2c277e2-f59d-4d3c-b21e-aa48fa7c9a59 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:55.415498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2c277e2-f59d-4d3c-b21e-aa48fa7c9a59 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:55.416253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2c277e2-f59d-4d3c-b21e-aa48fa7c9a59 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:55.416715 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2c277e2-f59d-4d3c-b21e-aa48fa7c9a59 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:55.417144 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2c277e2-f59d-4d3c-b21e-aa48fa7c9a59 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:55.510877 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5178bae2-d17d-4b58-b318-7b75f6de738d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:55.511715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5178bae2-d17d-4b58-b318-7b75f6de738d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:55.517873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5178bae2-d17d-4b58-b318-7b75f6de738d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:55.519330 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5178bae2-d17d-4b58-b318-7b75f6de738d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:55.519330 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5178bae2-d17d-4b58-b318-7b75f6de738d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:55.520111 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5178bae2-d17d-4b58-b318-7b75f6de738d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:55.520626 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5178bae2-d17d-4b58-b318-7b75f6de738d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:55.521213 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5178bae2-d17d-4b58-b318-7b75f6de738d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:55.563457 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a2c277e2-f59d-4d3c-b21e-aa48fa7c9a59 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:55.574185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a2c277e2-f59d-4d3c-b21e-aa48fa7c9a59 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.171524 Aug 24 08:56:55.575031 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 107/222] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:55 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:55.646621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b336c340-0b13-41af-b664-dfa9bc180c7d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:55.654693 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b336c340-0b13-41af-b664-dfa9bc180c7d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:55.662061 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b336c340-0b13-41af-b664-dfa9bc180c7d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:55.662460 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b336c340-0b13-41af-b664-dfa9bc180c7d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:55.662898 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b336c340-0b13-41af-b664-dfa9bc180c7d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:55.663634 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b336c340-0b13-41af-b664-dfa9bc180c7d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:55.664127 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b336c340-0b13-41af-b664-dfa9bc180c7d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:55.664567 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b336c340-0b13-41af-b664-dfa9bc180c7d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:55.693974 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5178bae2-d17d-4b58-b318-7b75f6de738d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:55.709028 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5178bae2-d17d-4b58-b318-7b75f6de738d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.201549 Aug 24 08:56:55.710025 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 116/223] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:55 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:55.821871 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b336c340-0b13-41af-b664-dfa9bc180c7d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:55.830574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b336c340-0b13-41af-b664-dfa9bc180c7d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.194998 Aug 24 08:56:55.831214 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 108/224] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:55 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:56.422584 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fa7919cc-6c3e-4195-8c84-82a0bce4f4d4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:56.423698 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fa7919cc-6c3e-4195-8c84-82a0bce4f4d4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:56.432459 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa7919cc-6c3e-4195-8c84-82a0bce4f4d4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:56.432937 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa7919cc-6c3e-4195-8c84-82a0bce4f4d4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:56.433368 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa7919cc-6c3e-4195-8c84-82a0bce4f4d4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:56.434073 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa7919cc-6c3e-4195-8c84-82a0bce4f4d4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:56.434659 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa7919cc-6c3e-4195-8c84-82a0bce4f4d4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:56.435138 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa7919cc-6c3e-4195-8c84-82a0bce4f4d4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:56.438091 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cd917bd9-32ab-4302-8433-dfa6baf6d57f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:56.439074 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cd917bd9-32ab-4302-8433-dfa6baf6d57f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:56.446390 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd917bd9-32ab-4302-8433-dfa6baf6d57f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:56.446902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd917bd9-32ab-4302-8433-dfa6baf6d57f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:56.447355 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd917bd9-32ab-4302-8433-dfa6baf6d57f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:56.448044 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd917bd9-32ab-4302-8433-dfa6baf6d57f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:56.448551 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd917bd9-32ab-4302-8433-dfa6baf6d57f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:56.448976 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd917bd9-32ab-4302-8433-dfa6baf6d57f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:56.656736 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-fa7919cc-6c3e-4195-8c84-82a0bce4f4d4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:56.659076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:56.666443 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fa7919cc-6c3e-4195-8c84-82a0bce4f4d4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.250493 Aug 24 08:56:56.667032 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 117/225] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:56 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:56.668368 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cd917bd9-32ab-4302-8433-dfa6baf6d57f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:56.672725 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ad1ce4d-9afc-4239-a638-f682e225b3a1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:56.684433 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:56.684433 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cd917bd9-32ab-4302-8433-dfa6baf6d57f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:56.684433 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cd917bd9-32ab-4302-8433-dfa6baf6d57f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:56.684778 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cd917bd9-32ab-4302-8433-dfa6baf6d57f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.249231 Aug 24 08:56:56.684778 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 109/226] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:56 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:56.685872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9ad1ce4d-9afc-4239-a638-f682e225b3a1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:56.693717 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ad1ce4d-9afc-4239-a638-f682e225b3a1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:56.694113 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ad1ce4d-9afc-4239-a638-f682e225b3a1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:56.694550 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ad1ce4d-9afc-4239-a638-f682e225b3a1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:56.695443 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ad1ce4d-9afc-4239-a638-f682e225b3a1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:56.696151 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ad1ce4d-9afc-4239-a638-f682e225b3a1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:56.696656 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ad1ce4d-9afc-4239-a638-f682e225b3a1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:56.736171 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f71f01da-2cde-436b-9388-71847293a495 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:56.737084 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f71f01da-2cde-436b-9388-71847293a495 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:56.744788 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f71f01da-2cde-436b-9388-71847293a495 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:56.745212 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f71f01da-2cde-436b-9388-71847293a495 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:56.745652 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f71f01da-2cde-436b-9388-71847293a495 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:56.746365 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f71f01da-2cde-436b-9388-71847293a495 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:56.746822 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f71f01da-2cde-436b-9388-71847293a495 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:56.747249 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f71f01da-2cde-436b-9388-71847293a495 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:56.982402 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ad1ce4d-9afc-4239-a638-f682e225b3a1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:56.990346 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ad1ce4d-9afc-4239-a638-f682e225b3a1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.321915 Aug 24 08:56:56.991198 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 118/227] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:56 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:56.996411 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c3fb4551-c0ca-4e9d-ab1e-f6f25d14fc58 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:56.997011 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c3fb4551-c0ca-4e9d-ab1e-f6f25d14fc58 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:57.009385 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3fb4551-c0ca-4e9d-ab1e-f6f25d14fc58 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:57.009882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3fb4551-c0ca-4e9d-ab1e-f6f25d14fc58 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:57.010315 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3fb4551-c0ca-4e9d-ab1e-f6f25d14fc58 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:57.011021 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3fb4551-c0ca-4e9d-ab1e-f6f25d14fc58 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:57.011477 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3fb4551-c0ca-4e9d-ab1e-f6f25d14fc58 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:57.011898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3fb4551-c0ca-4e9d-ab1e-f6f25d14fc58 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:57.014229 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f71f01da-2cde-436b-9388-71847293a495 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:57.022712 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f71f01da-2cde-436b-9388-71847293a495 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.293655 Aug 24 08:56:57.023304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 110/228] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:56 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:57.151461 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c3fb4551-c0ca-4e9d-ab1e-f6f25d14fc58 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:57.159934 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c3fb4551-c0ca-4e9d-ab1e-f6f25d14fc58 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.167177 Aug 24 08:56:57.160903 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 119/229] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:56 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:57.688812 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c31f9962-4f51-415c-a96b-19be0447a81e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:57.689430 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c31f9962-4f51-415c-a96b-19be0447a81e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:57.696706 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31f9962-4f51-415c-a96b-19be0447a81e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:57.697249 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31f9962-4f51-415c-a96b-19be0447a81e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:57.697682 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31f9962-4f51-415c-a96b-19be0447a81e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:57.698378 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31f9962-4f51-415c-a96b-19be0447a81e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:57.700481 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31f9962-4f51-415c-a96b-19be0447a81e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:57.700481 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c31f9962-4f51-415c-a96b-19be0447a81e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:57.707170 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d7335141-79c4-4ac0-9eba-b8299cc6e9be tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:57.708059 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d7335141-79c4-4ac0-9eba-b8299cc6e9be tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:57.714621 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7335141-79c4-4ac0-9eba-b8299cc6e9be tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:57.715196 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7335141-79c4-4ac0-9eba-b8299cc6e9be tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:57.715808 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7335141-79c4-4ac0-9eba-b8299cc6e9be tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:57.716987 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7335141-79c4-4ac0-9eba-b8299cc6e9be tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:57.717701 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7335141-79c4-4ac0-9eba-b8299cc6e9be tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:57.718483 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d7335141-79c4-4ac0-9eba-b8299cc6e9be tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:57.924785 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c31f9962-4f51-415c-a96b-19be0447a81e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:57.930680 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d7335141-79c4-4ac0-9eba-b8299cc6e9be tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:57.934769 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c31f9962-4f51-415c-a96b-19be0447a81e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.250083 Aug 24 08:56:57.939446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 111/230] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:57 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:57.939581 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d7335141-79c4-4ac0-9eba-b8299cc6e9be tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:57.941518 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d7335141-79c4-4ac0-9eba-b8299cc6e9be tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:57.942635 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d7335141-79c4-4ac0-9eba-b8299cc6e9be tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.240877 Aug 24 08:56:57.943186 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 120/231] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:57 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:56:58.010843 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7b14e3d4-8dc7-455d-9a1f-969ce1bbd830 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:58.011450 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7b14e3d4-8dc7-455d-9a1f-969ce1bbd830 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:58.017355 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b14e3d4-8dc7-455d-9a1f-969ce1bbd830 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:58.017832 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b14e3d4-8dc7-455d-9a1f-969ce1bbd830 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:58.018259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b14e3d4-8dc7-455d-9a1f-969ce1bbd830 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:58.019525 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b14e3d4-8dc7-455d-9a1f-969ce1bbd830 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:58.019976 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b14e3d4-8dc7-455d-9a1f-969ce1bbd830 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:58.020434 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b14e3d4-8dc7-455d-9a1f-969ce1bbd830 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:58.045404 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c63a18af-a1ed-43fd-87e3-89c3a80565ce tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:58.046011 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c63a18af-a1ed-43fd-87e3-89c3a80565ce tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:58.052765 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c63a18af-a1ed-43fd-87e3-89c3a80565ce tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:58.053261 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c63a18af-a1ed-43fd-87e3-89c3a80565ce tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:58.053920 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c63a18af-a1ed-43fd-87e3-89c3a80565ce tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:58.054636 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c63a18af-a1ed-43fd-87e3-89c3a80565ce tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:58.055102 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c63a18af-a1ed-43fd-87e3-89c3a80565ce tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:58.055528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c63a18af-a1ed-43fd-87e3-89c3a80565ce tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:58.218107 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7b14e3d4-8dc7-455d-9a1f-969ce1bbd830 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:58.226709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7b14e3d4-8dc7-455d-9a1f-969ce1bbd830 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.219636 Aug 24 08:56:58.227296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 112/232] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:58 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:58.231816 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-44b9cb42-c3b6-4eb0-b274-fb1157f9efad tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:58.232463 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-44b9cb42-c3b6-4eb0-b274-fb1157f9efad tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:58.239574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44b9cb42-c3b6-4eb0-b274-fb1157f9efad tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:58.240088 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44b9cb42-c3b6-4eb0-b274-fb1157f9efad tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:58.240576 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44b9cb42-c3b6-4eb0-b274-fb1157f9efad tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:58.241740 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44b9cb42-c3b6-4eb0-b274-fb1157f9efad tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:58.242056 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44b9cb42-c3b6-4eb0-b274-fb1157f9efad tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:58.242484 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44b9cb42-c3b6-4eb0-b274-fb1157f9efad tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:58.244456 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c63a18af-a1ed-43fd-87e3-89c3a80565ce tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:58.252518 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c63a18af-a1ed-43fd-87e3-89c3a80565ce tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.211143 Aug 24 08:56:58.253146 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 121/233] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:58 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:58.387602 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-44b9cb42-c3b6-4eb0-b274-fb1157f9efad tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:58.395763 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-44b9cb42-c3b6-4eb0-b274-fb1157f9efad tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.167407 Aug 24 08:56:58.396377 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 113/234] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:58 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:58.957397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-187ce9a1-ed73-47da-b9d4-d9cb828fa8c1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:58.958070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-187ce9a1-ed73-47da-b9d4-d9cb828fa8c1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:58.964424 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-187ce9a1-ed73-47da-b9d4-d9cb828fa8c1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:58.964923 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-187ce9a1-ed73-47da-b9d4-d9cb828fa8c1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:58.965258 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-555dd580-1654-4369-ae66-604ff8911b54 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:58.965703 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-187ce9a1-ed73-47da-b9d4-d9cb828fa8c1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:58.965868 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-555dd580-1654-4369-ae66-604ff8911b54 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:58.966052 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-187ce9a1-ed73-47da-b9d4-d9cb828fa8c1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:58.966508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-187ce9a1-ed73-47da-b9d4-d9cb828fa8c1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:58.966933 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-187ce9a1-ed73-47da-b9d4-d9cb828fa8c1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:58.971966 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-555dd580-1654-4369-ae66-604ff8911b54 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:58.973194 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-555dd580-1654-4369-ae66-604ff8911b54 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:58.973629 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-555dd580-1654-4369-ae66-604ff8911b54 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:58.974335 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-555dd580-1654-4369-ae66-604ff8911b54 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:58.974785 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-555dd580-1654-4369-ae66-604ff8911b54 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:58.975205 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-555dd580-1654-4369-ae66-604ff8911b54 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:59.167501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-187ce9a1-ed73-47da-b9d4-d9cb828fa8c1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:59.175442 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-187ce9a1-ed73-47da-b9d4-d9cb828fa8c1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.222513 Aug 24 08:56:59.176464 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 122/235] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:58 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:59.179429 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-555dd580-1654-4369-ae66-604ff8911b54 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:59.188405 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-555dd580-1654-4369-ae66-604ff8911b54 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:59.190057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-555dd580-1654-4369-ae66-604ff8911b54 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:59.191984 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-555dd580-1654-4369-ae66-604ff8911b54 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.230423 Aug 24 08:56:59.192609 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 114/236] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:56:58 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:56:59.249121 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c5d66b66-a08a-4ca7-828a-bb3b104c2b57 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:59.249727 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c5d66b66-a08a-4ca7-828a-bb3b104c2b57 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:59.259797 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5d66b66-a08a-4ca7-828a-bb3b104c2b57 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:59.260336 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5d66b66-a08a-4ca7-828a-bb3b104c2b57 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:59.260790 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5d66b66-a08a-4ca7-828a-bb3b104c2b57 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:59.261493 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5d66b66-a08a-4ca7-828a-bb3b104c2b57 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:59.261954 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5d66b66-a08a-4ca7-828a-bb3b104c2b57 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:59.262376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5d66b66-a08a-4ca7-828a-bb3b104c2b57 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:59.274998 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c6b68f37-994e-40c5-90d8-ab22ee95fc65 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:59.275418 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c6b68f37-994e-40c5-90d8-ab22ee95fc65 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:59.282248 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6b68f37-994e-40c5-90d8-ab22ee95fc65 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:59.282750 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6b68f37-994e-40c5-90d8-ab22ee95fc65 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:59.283193 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6b68f37-994e-40c5-90d8-ab22ee95fc65 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:59.283908 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6b68f37-994e-40c5-90d8-ab22ee95fc65 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:59.285320 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6b68f37-994e-40c5-90d8-ab22ee95fc65 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:59.285761 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c6b68f37-994e-40c5-90d8-ab22ee95fc65 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:59.464614 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c5d66b66-a08a-4ca7-828a-bb3b104c2b57 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:59.475403 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c5d66b66-a08a-4ca7-828a-bb3b104c2b57 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.230944 Aug 24 08:56:59.476029 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 123/237] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:59 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:56:59.480877 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bec88543-51ff-4230-aaa8-afc100254c09 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:56:59.481468 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bec88543-51ff-4230-aaa8-afc100254c09 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:56:59.488439 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c6b68f37-994e-40c5-90d8-ab22ee95fc65 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:59.492829 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bec88543-51ff-4230-aaa8-afc100254c09 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:59.493478 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bec88543-51ff-4230-aaa8-afc100254c09 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:59.493960 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bec88543-51ff-4230-aaa8-afc100254c09 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:59.494861 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bec88543-51ff-4230-aaa8-afc100254c09 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:56:59.495826 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bec88543-51ff-4230-aaa8-afc100254c09 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:56:59.496357 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bec88543-51ff-4230-aaa8-afc100254c09 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:56:59.498384 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c6b68f37-994e-40c5-90d8-ab22ee95fc65 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.226725 Aug 24 08:56:59.498988 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 115/238] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:59 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:56:59.632878 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-bec88543-51ff-4230-aaa8-afc100254c09 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:56:59.640725 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bec88543-51ff-4230-aaa8-afc100254c09 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.163404 Aug 24 08:56:59.641292 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 124/239] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:56:59 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:00.196009 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a01309d5-791e-4a26-a2d9-5195f33bc1bb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:00.196812 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a01309d5-791e-4a26-a2d9-5195f33bc1bb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:00.203040 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a01309d5-791e-4a26-a2d9-5195f33bc1bb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:00.203536 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a01309d5-791e-4a26-a2d9-5195f33bc1bb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:00.203978 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a01309d5-791e-4a26-a2d9-5195f33bc1bb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:00.204707 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a01309d5-791e-4a26-a2d9-5195f33bc1bb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:00.205226 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a01309d5-791e-4a26-a2d9-5195f33bc1bb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:00.205684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a01309d5-791e-4a26-a2d9-5195f33bc1bb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:00.214707 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ed4983d0-7e87-46bc-85de-7a9255e1c9b2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:00.215317 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ed4983d0-7e87-46bc-85de-7a9255e1c9b2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:00.221586 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed4983d0-7e87-46bc-85de-7a9255e1c9b2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:00.223319 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed4983d0-7e87-46bc-85de-7a9255e1c9b2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:00.224721 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed4983d0-7e87-46bc-85de-7a9255e1c9b2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:00.225277 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed4983d0-7e87-46bc-85de-7a9255e1c9b2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:00.226239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed4983d0-7e87-46bc-85de-7a9255e1c9b2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:00.226936 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ed4983d0-7e87-46bc-85de-7a9255e1c9b2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:00.464242 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a01309d5-791e-4a26-a2d9-5195f33bc1bb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:00.468538 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ed4983d0-7e87-46bc-85de-7a9255e1c9b2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:00.472844 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a01309d5-791e-4a26-a2d9-5195f33bc1bb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.280172 Aug 24 08:57:00.473432 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 116/240] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:00 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:00.479147 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ed4983d0-7e87-46bc-85de-7a9255e1c9b2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:00.480840 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ed4983d0-7e87-46bc-85de-7a9255e1c9b2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:00.482147 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ed4983d0-7e87-46bc-85de-7a9255e1c9b2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.271132 Aug 24 08:57:00.482748 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 125/241] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:00 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:57:00.501250 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eb46915e-a489-44fb-81da-b2530ac27f39 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:00.501873 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eb46915e-a489-44fb-81da-b2530ac27f39 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:00.509209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb46915e-a489-44fb-81da-b2530ac27f39 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:00.509708 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb46915e-a489-44fb-81da-b2530ac27f39 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:00.510150 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb46915e-a489-44fb-81da-b2530ac27f39 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:00.510871 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb46915e-a489-44fb-81da-b2530ac27f39 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:00.511333 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb46915e-a489-44fb-81da-b2530ac27f39 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:00.511762 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eb46915e-a489-44fb-81da-b2530ac27f39 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:00.522640 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1e39de0b-a820-4482-a9cd-83d2ac85fb3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:00.523243 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1e39de0b-a820-4482-a9cd-83d2ac85fb3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:00.529380 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e39de0b-a820-4482-a9cd-83d2ac85fb3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:00.529882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e39de0b-a820-4482-a9cd-83d2ac85fb3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:00.530318 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e39de0b-a820-4482-a9cd-83d2ac85fb3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:00.531023 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e39de0b-a820-4482-a9cd-83d2ac85fb3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:00.531482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e39de0b-a820-4482-a9cd-83d2ac85fb3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:00.531909 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e39de0b-a820-4482-a9cd-83d2ac85fb3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:00.726758 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-eb46915e-a489-44fb-81da-b2530ac27f39 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:00.730363 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1e39de0b-a820-4482-a9cd-83d2ac85fb3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:00.736724 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eb46915e-a489-44fb-81da-b2530ac27f39 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.239203 Aug 24 08:57:00.737572 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 117/242] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:00 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:00.739515 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1e39de0b-a820-4482-a9cd-83d2ac85fb3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.221174 Aug 24 08:57:00.744778 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a1f54294-168b-4aa1-ba4c-133a38944cb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:00.745802 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a1f54294-168b-4aa1-ba4c-133a38944cb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:00.753380 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 126/243] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:00 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:00.754973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1f54294-168b-4aa1-ba4c-133a38944cb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:00.755661 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1f54294-168b-4aa1-ba4c-133a38944cb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:00.756129 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1f54294-168b-4aa1-ba4c-133a38944cb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:00.757731 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1f54294-168b-4aa1-ba4c-133a38944cb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:00.758402 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1f54294-168b-4aa1-ba4c-133a38944cb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:00.758849 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1f54294-168b-4aa1-ba4c-133a38944cb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:00.920143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a1f54294-168b-4aa1-ba4c-133a38944cb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:00.928975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a1f54294-168b-4aa1-ba4c-133a38944cb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.189392 Aug 24 08:57:00.929576 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 118/244] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:00 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:01.495433 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f603cec0-5136-4afe-959a-84c9bdfe2e3d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:01.496068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f603cec0-5136-4afe-959a-84c9bdfe2e3d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:01.502411 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f603cec0-5136-4afe-959a-84c9bdfe2e3d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:01.503203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f603cec0-5136-4afe-959a-84c9bdfe2e3d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:01.503991 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f603cec0-5136-4afe-959a-84c9bdfe2e3d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:01.504917 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f603cec0-5136-4afe-959a-84c9bdfe2e3d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:01.505373 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f603cec0-5136-4afe-959a-84c9bdfe2e3d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:01.505799 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f603cec0-5136-4afe-959a-84c9bdfe2e3d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:01.507852 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-362eac1c-d5ee-404d-8fb3-025bfc2754d8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:01.508554 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-362eac1c-d5ee-404d-8fb3-025bfc2754d8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:01.514552 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-362eac1c-d5ee-404d-8fb3-025bfc2754d8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:01.515041 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-362eac1c-d5ee-404d-8fb3-025bfc2754d8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:01.515478 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-362eac1c-d5ee-404d-8fb3-025bfc2754d8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:01.516209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-362eac1c-d5ee-404d-8fb3-025bfc2754d8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:01.516695 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-362eac1c-d5ee-404d-8fb3-025bfc2754d8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:01.517121 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-362eac1c-d5ee-404d-8fb3-025bfc2754d8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:01.716192 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-362eac1c-d5ee-404d-8fb3-025bfc2754d8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:01.726594 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f603cec0-5136-4afe-959a-84c9bdfe2e3d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:01.726868 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-362eac1c-d5ee-404d-8fb3-025bfc2754d8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:01.728534 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-362eac1c-d5ee-404d-8fb3-025bfc2754d8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:01.729782 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-362eac1c-d5ee-404d-8fb3-025bfc2754d8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.225837 Aug 24 08:57:01.730447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 119/245] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:01 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:57:01.735313 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f603cec0-5136-4afe-959a-84c9bdfe2e3d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.244093 Aug 24 08:57:01.739978 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 127/246] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:01 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:01.761404 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1639169d-d916-48db-8c92-9a1a54bfc245 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:01.761992 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1639169d-d916-48db-8c92-9a1a54bfc245 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:01.765514 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e29e0941-3e98-475d-97cc-9d90235fb972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:01.766432 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e29e0941-3e98-475d-97cc-9d90235fb972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:01.768617 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1639169d-d916-48db-8c92-9a1a54bfc245 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:01.769795 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1639169d-d916-48db-8c92-9a1a54bfc245 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:01.770392 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1639169d-d916-48db-8c92-9a1a54bfc245 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:01.771345 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1639169d-d916-48db-8c92-9a1a54bfc245 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:01.771809 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1639169d-d916-48db-8c92-9a1a54bfc245 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:01.772324 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1639169d-d916-48db-8c92-9a1a54bfc245 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:01.774095 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e29e0941-3e98-475d-97cc-9d90235fb972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:01.774593 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e29e0941-3e98-475d-97cc-9d90235fb972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:01.775035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e29e0941-3e98-475d-97cc-9d90235fb972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:01.775743 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e29e0941-3e98-475d-97cc-9d90235fb972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:01.776235 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e29e0941-3e98-475d-97cc-9d90235fb972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:01.776870 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e29e0941-3e98-475d-97cc-9d90235fb972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:01.978440 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1639169d-d916-48db-8c92-9a1a54bfc245 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:01.986643 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1639169d-d916-48db-8c92-9a1a54bfc245 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.229520 Aug 24 08:57:01.986780 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e29e0941-3e98-475d-97cc-9d90235fb972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:01.987385 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 120/247] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:01 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:01.993451 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e12da534-71f5-400e-a16c-60b6f194a8a7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:01.994378 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e12da534-71f5-400e-a16c-60b6f194a8a7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:01.996812 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e29e0941-3e98-475d-97cc-9d90235fb972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.235403 Aug 24 08:57:01.997665 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 128/248] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:01 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:02.002953 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e12da534-71f5-400e-a16c-60b6f194a8a7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:02.003636 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e12da534-71f5-400e-a16c-60b6f194a8a7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:02.004321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e12da534-71f5-400e-a16c-60b6f194a8a7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:02.005042 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e12da534-71f5-400e-a16c-60b6f194a8a7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:02.005506 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e12da534-71f5-400e-a16c-60b6f194a8a7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:02.005935 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e12da534-71f5-400e-a16c-60b6f194a8a7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:02.170992 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e12da534-71f5-400e-a16c-60b6f194a8a7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:02.180385 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e12da534-71f5-400e-a16c-60b6f194a8a7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.191086 Aug 24 08:57:02.180976 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 121/249] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:01 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:02.758144 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f988d292-b0dc-4cf3-8cc3-59e8942b7b1e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:02.758805 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0679a94f-5da4-4183-9408-de7eef1710c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:02.759167 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f988d292-b0dc-4cf3-8cc3-59e8942b7b1e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:02.759598 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0679a94f-5da4-4183-9408-de7eef1710c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:02.765084 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f988d292-b0dc-4cf3-8cc3-59e8942b7b1e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:02.765578 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f988d292-b0dc-4cf3-8cc3-59e8942b7b1e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:02.766016 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f988d292-b0dc-4cf3-8cc3-59e8942b7b1e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:02.766728 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f988d292-b0dc-4cf3-8cc3-59e8942b7b1e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:02.767187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f988d292-b0dc-4cf3-8cc3-59e8942b7b1e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:02.767614 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f988d292-b0dc-4cf3-8cc3-59e8942b7b1e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:02.770551 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0679a94f-5da4-4183-9408-de7eef1710c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:02.771259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0679a94f-5da4-4183-9408-de7eef1710c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:02.771815 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0679a94f-5da4-4183-9408-de7eef1710c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:02.772752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0679a94f-5da4-4183-9408-de7eef1710c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:02.773214 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0679a94f-5da4-4183-9408-de7eef1710c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:02.773642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0679a94f-5da4-4183-9408-de7eef1710c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:02.991956 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0679a94f-5da4-4183-9408-de7eef1710c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:03.001347 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0679a94f-5da4-4183-9408-de7eef1710c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:03.002907 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0679a94f-5da4-4183-9408-de7eef1710c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:03.005270 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0679a94f-5da4-4183-9408-de7eef1710c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.255296 Aug 24 08:57:03.005850 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 129/250] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:02 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:57:03.008798 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f988d292-b0dc-4cf3-8cc3-59e8942b7b1e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:03.012142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3cbc90a9-8299-44f8-afd8-1b20e41d433f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:03.013043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3cbc90a9-8299-44f8-afd8-1b20e41d433f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:03.020069 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f988d292-b0dc-4cf3-8cc3-59e8942b7b1e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.266236 Aug 24 08:57:03.023301 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cbc90a9-8299-44f8-afd8-1b20e41d433f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:03.023928 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cbc90a9-8299-44f8-afd8-1b20e41d433f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:03.024477 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cbc90a9-8299-44f8-afd8-1b20e41d433f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:03.024622 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 122/251] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:02 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:03.026045 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cbc90a9-8299-44f8-afd8-1b20e41d433f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:03.027360 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cbc90a9-8299-44f8-afd8-1b20e41d433f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:03.028147 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cbc90a9-8299-44f8-afd8-1b20e41d433f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:03.038596 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2df847c7-6020-4c62-9aa6-0077cad4dc86 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:03.040026 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2df847c7-6020-4c62-9aa6-0077cad4dc86 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:03.049270 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2df847c7-6020-4c62-9aa6-0077cad4dc86 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:03.050129 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2df847c7-6020-4c62-9aa6-0077cad4dc86 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:03.052013 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2df847c7-6020-4c62-9aa6-0077cad4dc86 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:03.053053 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2df847c7-6020-4c62-9aa6-0077cad4dc86 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:03.053554 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2df847c7-6020-4c62-9aa6-0077cad4dc86 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:03.054202 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2df847c7-6020-4c62-9aa6-0077cad4dc86 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:03.425311 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3cbc90a9-8299-44f8-afd8-1b20e41d433f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:03.433405 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3cbc90a9-8299-44f8-afd8-1b20e41d433f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.426135 Aug 24 08:57:03.433987 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 130/252] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:03 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:03.438622 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-15f8c49d-a259-4e95-a0c6-945aa42028f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:03.439237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-15f8c49d-a259-4e95-a0c6-945aa42028f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:03.446006 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15f8c49d-a259-4e95-a0c6-945aa42028f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:03.446505 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15f8c49d-a259-4e95-a0c6-945aa42028f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:03.446942 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15f8c49d-a259-4e95-a0c6-945aa42028f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:03.447788 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15f8c49d-a259-4e95-a0c6-945aa42028f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:03.448119 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15f8c49d-a259-4e95-a0c6-945aa42028f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:03.448552 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-15f8c49d-a259-4e95-a0c6-945aa42028f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:03.455396 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2df847c7-6020-4c62-9aa6-0077cad4dc86 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:03.464591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2df847c7-6020-4c62-9aa6-0077cad4dc86 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.432950 Aug 24 08:57:03.465376 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 123/253] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:03 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:03.585911 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-15f8c49d-a259-4e95-a0c6-945aa42028f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:03.593657 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-15f8c49d-a259-4e95-a0c6-945aa42028f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.158682 Aug 24 08:57:03.594229 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 131/254] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:03 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:04.030307 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6090ed83-74fd-4418-ae66-99ae8a5844d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:04.031514 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6090ed83-74fd-4418-ae66-99ae8a5844d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:04.037995 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6090ed83-74fd-4418-ae66-99ae8a5844d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:04.038478 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6090ed83-74fd-4418-ae66-99ae8a5844d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:04.038908 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6090ed83-74fd-4418-ae66-99ae8a5844d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:04.039605 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6090ed83-74fd-4418-ae66-99ae8a5844d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:04.040059 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6090ed83-74fd-4418-ae66-99ae8a5844d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:04.040059 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6090ed83-74fd-4418-ae66-99ae8a5844d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:04.046791 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-745cd861-f4ac-4ff6-b776-120047bbfa20 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:04.047530 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-745cd861-f4ac-4ff6-b776-120047bbfa20 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:04.054060 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-745cd861-f4ac-4ff6-b776-120047bbfa20 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:04.054552 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-745cd861-f4ac-4ff6-b776-120047bbfa20 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:04.054993 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-745cd861-f4ac-4ff6-b776-120047bbfa20 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:04.055699 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-745cd861-f4ac-4ff6-b776-120047bbfa20 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:04.056180 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-745cd861-f4ac-4ff6-b776-120047bbfa20 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:04.056610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-745cd861-f4ac-4ff6-b776-120047bbfa20 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:04.249348 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6090ed83-74fd-4418-ae66-99ae8a5844d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:04.257624 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-745cd861-f4ac-4ff6-b776-120047bbfa20 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:04.266021 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6090ed83-74fd-4418-ae66-99ae8a5844d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:04.267360 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-745cd861-f4ac-4ff6-b776-120047bbfa20 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.224083 Aug 24 08:57:04.267649 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6090ed83-74fd-4418-ae66-99ae8a5844d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:04.268016 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 132/255] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:04 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:04.268708 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6090ed83-74fd-4418-ae66-99ae8a5844d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.242489 Aug 24 08:57:04.269775 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 124/256] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:04 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:57:04.454886 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2bcb41ab-c66b-44f6-9a7f-00df1acb2d42 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:04.455531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2bcb41ab-c66b-44f6-9a7f-00df1acb2d42 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:04.462436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bcb41ab-c66b-44f6-9a7f-00df1acb2d42 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:04.462928 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bcb41ab-c66b-44f6-9a7f-00df1acb2d42 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:04.463389 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bcb41ab-c66b-44f6-9a7f-00df1acb2d42 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:04.464114 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bcb41ab-c66b-44f6-9a7f-00df1acb2d42 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:04.464591 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bcb41ab-c66b-44f6-9a7f-00df1acb2d42 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:04.465019 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bcb41ab-c66b-44f6-9a7f-00df1acb2d42 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:04.486493 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-81b391d8-dd3f-4dc7-a016-4bc951c705c1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:04.487252 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-81b391d8-dd3f-4dc7-a016-4bc951c705c1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:04.494508 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81b391d8-dd3f-4dc7-a016-4bc951c705c1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:04.494999 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81b391d8-dd3f-4dc7-a016-4bc951c705c1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:04.495435 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81b391d8-dd3f-4dc7-a016-4bc951c705c1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:04.496163 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81b391d8-dd3f-4dc7-a016-4bc951c705c1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:04.496622 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81b391d8-dd3f-4dc7-a016-4bc951c705c1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:04.497049 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81b391d8-dd3f-4dc7-a016-4bc951c705c1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:04.785803 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-2bcb41ab-c66b-44f6-9a7f-00df1acb2d42 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:04.793761 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2bcb41ab-c66b-44f6-9a7f-00df1acb2d42 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.342664 Aug 24 08:57:04.794674 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 133/257] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:04 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:04.799382 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2eb6d619-ec5c-40a6-a351-1d445c6eefe7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:04.799998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2eb6d619-ec5c-40a6-a351-1d445c6eefe7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:04.802348 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:04.802787 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-81b391d8-dd3f-4dc7-a016-4bc951c705c1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:04.809122 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2eb6d619-ec5c-40a6-a351-1d445c6eefe7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:04.809624 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2eb6d619-ec5c-40a6-a351-1d445c6eefe7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:04.810098 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2eb6d619-ec5c-40a6-a351-1d445c6eefe7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:04.810806 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2eb6d619-ec5c-40a6-a351-1d445c6eefe7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:04.811558 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2eb6d619-ec5c-40a6-a351-1d445c6eefe7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:04.811672 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2eb6d619-ec5c-40a6-a351-1d445c6eefe7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:04.814115 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-81b391d8-dd3f-4dc7-a016-4bc951c705c1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.331788 Aug 24 08:57:04.814983 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 125/258] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:04 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:04.828582 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:04.952966 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-2eb6d619-ec5c-40a6-a351-1d445c6eefe7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:04.961915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2eb6d619-ec5c-40a6-a351-1d445c6eefe7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.166063 Aug 24 08:57:04.962418 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 134/259] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:04 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:05.290195 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-48b098ae-b598-4372-90e7-53cbc675954d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:05.291082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-48b098ae-b598-4372-90e7-53cbc675954d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:05.293633 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8a0e7c55-4212-4c78-b570-1bb4c659d431 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:05.294374 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8a0e7c55-4212-4c78-b570-1bb4c659d431 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:05.297715 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48b098ae-b598-4372-90e7-53cbc675954d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:05.298297 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48b098ae-b598-4372-90e7-53cbc675954d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:05.298801 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48b098ae-b598-4372-90e7-53cbc675954d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:05.299588 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48b098ae-b598-4372-90e7-53cbc675954d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:05.300147 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48b098ae-b598-4372-90e7-53cbc675954d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:05.301185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-48b098ae-b598-4372-90e7-53cbc675954d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:05.301900 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a0e7c55-4212-4c78-b570-1bb4c659d431 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:05.303148 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a0e7c55-4212-4c78-b570-1bb4c659d431 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:05.303613 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a0e7c55-4212-4c78-b570-1bb4c659d431 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:05.305786 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a0e7c55-4212-4c78-b570-1bb4c659d431 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:05.307834 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a0e7c55-4212-4c78-b570-1bb4c659d431 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:05.307834 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a0e7c55-4212-4c78-b570-1bb4c659d431 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:05.324277 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:05.537064 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-48b098ae-b598-4372-90e7-53cbc675954d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:05.547848 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-48b098ae-b598-4372-90e7-53cbc675954d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.262359 Aug 24 08:57:05.548725 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 126/260] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:05 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:05.550230 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8a0e7c55-4212-4c78-b570-1bb4c659d431 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:05.562182 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8a0e7c55-4212-4c78-b570-1bb4c659d431 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:05.565034 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8a0e7c55-4212-4c78-b570-1bb4c659d431 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:05.567559 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8a0e7c55-4212-4c78-b570-1bb4c659d431 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.277993 Aug 24 08:57:05.568587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 135/261] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:05 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:57:05.818981 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e89c62c4-1872-4649-b43c-2beec1b9d8ed tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:05.819895 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e89c62c4-1872-4649-b43c-2beec1b9d8ed tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:05.824635 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:05.828364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e89c62c4-1872-4649-b43c-2beec1b9d8ed tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:05.828866 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e89c62c4-1872-4649-b43c-2beec1b9d8ed tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:05.829307 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e89c62c4-1872-4649-b43c-2beec1b9d8ed tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:05.830021 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e89c62c4-1872-4649-b43c-2beec1b9d8ed tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:05.830485 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e89c62c4-1872-4649-b43c-2beec1b9d8ed tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:05.832587 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e89c62c4-1872-4649-b43c-2beec1b9d8ed tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:05.837296 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6e60acbe-b3cc-43f7-9e0e-ee8df7134903 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:05.837908 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6e60acbe-b3cc-43f7-9e0e-ee8df7134903 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:05.843982 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e60acbe-b3cc-43f7-9e0e-ee8df7134903 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:05.844525 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e60acbe-b3cc-43f7-9e0e-ee8df7134903 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:05.844957 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e60acbe-b3cc-43f7-9e0e-ee8df7134903 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:05.845652 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e60acbe-b3cc-43f7-9e0e-ee8df7134903 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:05.846105 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e60acbe-b3cc-43f7-9e0e-ee8df7134903 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:05.846528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e60acbe-b3cc-43f7-9e0e-ee8df7134903 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:06.043436 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e89c62c4-1872-4649-b43c-2beec1b9d8ed tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:06.046817 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-6e60acbe-b3cc-43f7-9e0e-ee8df7134903 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:06.051481 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e89c62c4-1872-4649-b43c-2beec1b9d8ed tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.239944 Aug 24 08:57:06.052167 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 127/262] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:05 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:06.054931 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6e60acbe-b3cc-43f7-9e0e-ee8df7134903 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.221423 Aug 24 08:57:06.055495 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 136/263] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:05 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:06.067590 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-afe1a0cf-fca5-4b45-a4cc-654bc88e0268 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:06.068369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-afe1a0cf-fca5-4b45-a4cc-654bc88e0268 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:06.075084 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afe1a0cf-fca5-4b45-a4cc-654bc88e0268 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:06.075763 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afe1a0cf-fca5-4b45-a4cc-654bc88e0268 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:06.076240 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afe1a0cf-fca5-4b45-a4cc-654bc88e0268 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:06.077148 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afe1a0cf-fca5-4b45-a4cc-654bc88e0268 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:06.077612 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afe1a0cf-fca5-4b45-a4cc-654bc88e0268 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:06.078037 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-afe1a0cf-fca5-4b45-a4cc-654bc88e0268 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:06.215141 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-afe1a0cf-fca5-4b45-a4cc-654bc88e0268 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:06.222896 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-afe1a0cf-fca5-4b45-a4cc-654bc88e0268 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.169578 Aug 24 08:57:06.223489 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 128/264] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:06 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:06.572770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3ffcec44-f903-4669-af18-479c1ca367fa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:06.572770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3ffcec44-f903-4669-af18-479c1ca367fa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:06.579382 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ffcec44-f903-4669-af18-479c1ca367fa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:06.579861 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ffcec44-f903-4669-af18-479c1ca367fa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:06.580395 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ffcec44-f903-4669-af18-479c1ca367fa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:06.581090 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ffcec44-f903-4669-af18-479c1ca367fa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:06.581538 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ffcec44-f903-4669-af18-479c1ca367fa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:06.582548 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ffcec44-f903-4669-af18-479c1ca367fa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:06.591818 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ca758d63-47c5-4348-a0dd-8e98095c6aeb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:06.592530 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ca758d63-47c5-4348-a0dd-8e98095c6aeb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:06.599033 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca758d63-47c5-4348-a0dd-8e98095c6aeb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:06.599449 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca758d63-47c5-4348-a0dd-8e98095c6aeb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:06.599883 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca758d63-47c5-4348-a0dd-8e98095c6aeb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:06.600589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca758d63-47c5-4348-a0dd-8e98095c6aeb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:06.601038 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca758d63-47c5-4348-a0dd-8e98095c6aeb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:06.601459 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ca758d63-47c5-4348-a0dd-8e98095c6aeb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:06.778749 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3ffcec44-f903-4669-af18-479c1ca367fa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:06.787577 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3ffcec44-f903-4669-af18-479c1ca367fa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.221465 Aug 24 08:57:06.788285 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 137/265] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:06 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:06.791098 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ca758d63-47c5-4348-a0dd-8e98095c6aeb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:06.799302 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ca758d63-47c5-4348-a0dd-8e98095c6aeb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:06.800943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ca758d63-47c5-4348-a0dd-8e98095c6aeb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:06.802051 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ca758d63-47c5-4348-a0dd-8e98095c6aeb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.214029 Aug 24 08:57:06.802610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 129/266] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:06 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:57:07.075094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a4291082-80f1-45fb-9429-55d28729601b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:07.075710 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a4291082-80f1-45fb-9429-55d28729601b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:07.075849 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bb73d50c-1c0c-425e-a78a-07c75f38385d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:07.076541 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bb73d50c-1c0c-425e-a78a-07c75f38385d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:07.082445 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4291082-80f1-45fb-9429-55d28729601b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:07.082684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bb73d50c-1c0c-425e-a78a-07c75f38385d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:07.082936 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4291082-80f1-45fb-9429-55d28729601b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:07.083043 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bb73d50c-1c0c-425e-a78a-07c75f38385d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:07.083378 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4291082-80f1-45fb-9429-55d28729601b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:07.083490 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bb73d50c-1c0c-425e-a78a-07c75f38385d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:07.084081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4291082-80f1-45fb-9429-55d28729601b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:07.084204 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bb73d50c-1c0c-425e-a78a-07c75f38385d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:07.084565 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4291082-80f1-45fb-9429-55d28729601b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:07.084660 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bb73d50c-1c0c-425e-a78a-07c75f38385d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:07.084989 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bb73d50c-1c0c-425e-a78a-07c75f38385d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:07.085080 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4291082-80f1-45fb-9429-55d28729601b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:07.287235 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a4291082-80f1-45fb-9429-55d28729601b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:07.299038 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a4291082-80f1-45fb-9429-55d28729601b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.228073 Aug 24 08:57:07.299844 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 138/267] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:07 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:07.306504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bc3a88a7-fb9d-4198-b62f-7c5e2481425b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:07.307128 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bc3a88a7-fb9d-4198-b62f-7c5e2481425b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:07.313584 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-bb73d50c-1c0c-425e-a78a-07c75f38385d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:07.314093 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc3a88a7-fb9d-4198-b62f-7c5e2481425b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:07.314762 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc3a88a7-fb9d-4198-b62f-7c5e2481425b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:07.315374 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc3a88a7-fb9d-4198-b62f-7c5e2481425b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:07.316320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc3a88a7-fb9d-4198-b62f-7c5e2481425b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:07.317851 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc3a88a7-fb9d-4198-b62f-7c5e2481425b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:07.318481 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bc3a88a7-fb9d-4198-b62f-7c5e2481425b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:07.326840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bb73d50c-1c0c-425e-a78a-07c75f38385d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.254529 Aug 24 08:57:07.341654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 130/268] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:07 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:07.402871 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-4ff03867-5974-4dd0-80f7-45392f93a526 req-d3f2c691-b4df-4fe0-a6f1-f1a2266b1c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4866e8f4-ddfe-4cee-8bcc-5db7372926f5", "name": "network-vif-plugged", "status": "completed", "tag": "4e1f25c9-676d-433c-8c1b-ae79e13a1625"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:07.418444 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4ff03867-5974-4dd0-80f7-45392f93a526 req-d3f2c691-b4df-4fe0-a6f1-f1a2266b1c87 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:07.419015 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4ff03867-5974-4dd0-80f7-45392f93a526 req-d3f2c691-b4df-4fe0-a6f1-f1a2266b1c87 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:07.419448 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4ff03867-5974-4dd0-80f7-45392f93a526 req-d3f2c691-b4df-4fe0-a6f1-f1a2266b1c87 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:07.435377 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-4ff03867-5974-4dd0-80f7-45392f93a526 req-d3f2c691-b4df-4fe0-a6f1-f1a2266b1c87 service nova] Creating event network-vif-plugged:4e1f25c9-676d-433c-8c1b-ae79e13a1625 for instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 on hv-cinder-83538 Aug 24 08:57:07.440878 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-4ff03867-5974-4dd0-80f7-45392f93a526 req-d3f2c691-b4df-4fe0-a6f1-f1a2266b1c87 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042981 Aug 24 08:57:07.441599 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 131/269] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:57:07.488660 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-bc3a88a7-fb9d-4198-b62f-7c5e2481425b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:07.496912 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bc3a88a7-fb9d-4198-b62f-7c5e2481425b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.196004 Aug 24 08:57:07.497489 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 139/270] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:07 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:07.808533 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cd1e7bb4-1243-48be-9f24-edb6324d4f0c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:07.809221 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cd1e7bb4-1243-48be-9f24-edb6324d4f0c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:07.815336 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd1e7bb4-1243-48be-9f24-edb6324d4f0c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:07.815814 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd1e7bb4-1243-48be-9f24-edb6324d4f0c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:07.816297 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd1e7bb4-1243-48be-9f24-edb6324d4f0c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:07.817079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd1e7bb4-1243-48be-9f24-edb6324d4f0c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:07.817536 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd1e7bb4-1243-48be-9f24-edb6324d4f0c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:07.817978 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd1e7bb4-1243-48be-9f24-edb6324d4f0c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:07.824609 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dc6863f4-52c9-418c-95b6-6e57c3ed75f0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:07.825227 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dc6863f4-52c9-418c-95b6-6e57c3ed75f0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:07.831433 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc6863f4-52c9-418c-95b6-6e57c3ed75f0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:07.831954 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc6863f4-52c9-418c-95b6-6e57c3ed75f0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:07.832412 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc6863f4-52c9-418c-95b6-6e57c3ed75f0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:07.833142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc6863f4-52c9-418c-95b6-6e57c3ed75f0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:07.833649 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc6863f4-52c9-418c-95b6-6e57c3ed75f0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:07.834017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dc6863f4-52c9-418c-95b6-6e57c3ed75f0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:08.017497 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cd1e7bb4-1243-48be-9f24-edb6324d4f0c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:08.024910 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-dc6863f4-52c9-418c-95b6-6e57c3ed75f0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:08.025908 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cd1e7bb4-1243-48be-9f24-edb6324d4f0c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.221560 Aug 24 08:57:08.026495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 132/271] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:07 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:08.033768 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-dc6863f4-52c9-418c-95b6-6e57c3ed75f0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:08.035364 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-dc6863f4-52c9-418c-95b6-6e57c3ed75f0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:08.036566 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dc6863f4-52c9-418c-95b6-6e57c3ed75f0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.216058 Aug 24 08:57:08.037138 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 140/272] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:07 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:57:08.341387 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a334c5b6-13bf-4bf8-969c-fe2957952162 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:08.342146 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a334c5b6-13bf-4bf8-969c-fe2957952162 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:08.348862 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a334c5b6-13bf-4bf8-969c-fe2957952162 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:08.349090 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c6a7d4cf-737f-42a0-a58a-1eb714a954ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:08.349385 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a334c5b6-13bf-4bf8-969c-fe2957952162 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:08.349699 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c6a7d4cf-737f-42a0-a58a-1eb714a954ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:08.349808 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a334c5b6-13bf-4bf8-969c-fe2957952162 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:08.350515 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a334c5b6-13bf-4bf8-969c-fe2957952162 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:08.350973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a334c5b6-13bf-4bf8-969c-fe2957952162 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:08.351405 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a334c5b6-13bf-4bf8-969c-fe2957952162 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:08.355794 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6a7d4cf-737f-42a0-a58a-1eb714a954ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:08.356322 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6a7d4cf-737f-42a0-a58a-1eb714a954ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:08.356755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6a7d4cf-737f-42a0-a58a-1eb714a954ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:08.357445 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6a7d4cf-737f-42a0-a58a-1eb714a954ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:08.357897 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6a7d4cf-737f-42a0-a58a-1eb714a954ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:08.358319 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6a7d4cf-737f-42a0-a58a-1eb714a954ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:08.571406 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a334c5b6-13bf-4bf8-969c-fe2957952162 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:08.574554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c6a7d4cf-737f-42a0-a58a-1eb714a954ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:08.579536 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a334c5b6-13bf-4bf8-969c-fe2957952162 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.241887 Aug 24 08:57:08.580411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 133/273] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:08 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:08.582868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c6a7d4cf-737f-42a0-a58a-1eb714a954ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.238070 Aug 24 08:57:08.583330 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 141/274] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:08 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:08.585240 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9064c617-f700-4679-952e-5beb4367d0b3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:08.586042 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9064c617-f700-4679-952e-5beb4367d0b3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:08.592178 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9064c617-f700-4679-952e-5beb4367d0b3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:08.592807 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9064c617-f700-4679-952e-5beb4367d0b3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:08.593271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9064c617-f700-4679-952e-5beb4367d0b3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:08.594204 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9064c617-f700-4679-952e-5beb4367d0b3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:08.594733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9064c617-f700-4679-952e-5beb4367d0b3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:08.595272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9064c617-f700-4679-952e-5beb4367d0b3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:08.748830 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9064c617-f700-4679-952e-5beb4367d0b3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:08.756886 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9064c617-f700-4679-952e-5beb4367d0b3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.175553 Aug 24 08:57:08.757482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 134/275] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:08 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:09.047368 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ecac6c4b-9f64-47e5-805a-4855e41d5830 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:09.047982 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ecac6c4b-9f64-47e5-805a-4855e41d5830 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:09.054206 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecac6c4b-9f64-47e5-805a-4855e41d5830 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:09.055067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecac6c4b-9f64-47e5-805a-4855e41d5830 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:09.055510 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecac6c4b-9f64-47e5-805a-4855e41d5830 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:09.056254 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecac6c4b-9f64-47e5-805a-4855e41d5830 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:09.056711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecac6c4b-9f64-47e5-805a-4855e41d5830 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:09.057133 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ecac6c4b-9f64-47e5-805a-4855e41d5830 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:09.059819 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0dba7b4c-744a-46f0-a226-357b660e9c9e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:09.060662 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0dba7b4c-744a-46f0-a226-357b660e9c9e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:09.067595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dba7b4c-744a-46f0-a226-357b660e9c9e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:09.068108 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dba7b4c-744a-46f0-a226-357b660e9c9e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:09.068553 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dba7b4c-744a-46f0-a226-357b660e9c9e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:09.069259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dba7b4c-744a-46f0-a226-357b660e9c9e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:09.069716 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dba7b4c-744a-46f0-a226-357b660e9c9e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:09.070141 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0dba7b4c-744a-46f0-a226-357b660e9c9e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:09.265307 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ecac6c4b-9f64-47e5-805a-4855e41d5830 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:09.268839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0dba7b4c-744a-46f0-a226-357b660e9c9e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:09.274451 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ecac6c4b-9f64-47e5-805a-4855e41d5830 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.230906 Aug 24 08:57:09.275050 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 142/276] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:09 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:09.278676 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0dba7b4c-744a-46f0-a226-357b660e9c9e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:09.280442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0dba7b4c-744a-46f0-a226-357b660e9c9e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:09.281579 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0dba7b4c-744a-46f0-a226-357b660e9c9e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.225876 Aug 24 08:57:09.282135 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 135/277] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:09 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:57:09.603399 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-281fa915-893c-4662-bec4-da6c180f8190 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:09.604396 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-281fa915-893c-4662-bec4-da6c180f8190 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:09.604592 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-602b9248-76a4-4194-80e7-d2f4544ec695 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:09.605047 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-602b9248-76a4-4194-80e7-d2f4544ec695 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:09.612290 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-602b9248-76a4-4194-80e7-d2f4544ec695 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:09.612787 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-602b9248-76a4-4194-80e7-d2f4544ec695 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:09.613053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-281fa915-893c-4662-bec4-da6c180f8190 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:09.613914 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-602b9248-76a4-4194-80e7-d2f4544ec695 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:09.614455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-281fa915-893c-4662-bec4-da6c180f8190 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:09.614624 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-602b9248-76a4-4194-80e7-d2f4544ec695 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:09.615030 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-602b9248-76a4-4194-80e7-d2f4544ec695 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:09.615203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-281fa915-893c-4662-bec4-da6c180f8190 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:09.615450 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-602b9248-76a4-4194-80e7-d2f4544ec695 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:09.616069 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-281fa915-893c-4662-bec4-da6c180f8190 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:09.616662 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-281fa915-893c-4662-bec4-da6c180f8190 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:09.617528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-281fa915-893c-4662-bec4-da6c180f8190 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:09.849591 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-281fa915-893c-4662-bec4-da6c180f8190 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:09.856377 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-602b9248-76a4-4194-80e7-d2f4544ec695 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:09.857776 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-281fa915-893c-4662-bec4-da6c180f8190 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.260962 Aug 24 08:57:09.858362 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 143/278] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:09 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:09.863961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3a600529-96de-4550-9b6c-1119dcb68be0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:09.864820 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3a600529-96de-4550-9b6c-1119dcb68be0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:09.870983 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-602b9248-76a4-4194-80e7-d2f4544ec695 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.270235 Aug 24 08:57:09.871689 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 136/279] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:09 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:09.877135 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a600529-96de-4550-9b6c-1119dcb68be0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:09.877659 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a600529-96de-4550-9b6c-1119dcb68be0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:09.878094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a600529-96de-4550-9b6c-1119dcb68be0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:09.878882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a600529-96de-4550-9b6c-1119dcb68be0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:09.879816 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a600529-96de-4550-9b6c-1119dcb68be0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:09.880273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a600529-96de-4550-9b6c-1119dcb68be0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.023166 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3a600529-96de-4550-9b6c-1119dcb68be0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:10.031210 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3a600529-96de-4550-9b6c-1119dcb68be0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.171535 Aug 24 08:57:10.031790 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 144/280] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:09 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:10.296545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3da269c9-114c-4043-9980-19a3903f800e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:10.297151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3da269c9-114c-4043-9980-19a3903f800e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:10.303882 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da269c9-114c-4043-9980-19a3903f800e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.304403 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da269c9-114c-4043-9980-19a3903f800e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.304847 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da269c9-114c-4043-9980-19a3903f800e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.305314 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-44b37c36-95b9-4aae-bae8-2e3f92afe3ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:10.305758 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da269c9-114c-4043-9980-19a3903f800e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.306015 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da269c9-114c-4043-9980-19a3903f800e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.306106 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-44b37c36-95b9-4aae-bae8-2e3f92afe3ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:10.306447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da269c9-114c-4043-9980-19a3903f800e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.312565 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44b37c36-95b9-4aae-bae8-2e3f92afe3ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.313068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44b37c36-95b9-4aae-bae8-2e3f92afe3ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.313501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44b37c36-95b9-4aae-bae8-2e3f92afe3ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.314225 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44b37c36-95b9-4aae-bae8-2e3f92afe3ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.314687 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44b37c36-95b9-4aae-bae8-2e3f92afe3ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.315113 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-44b37c36-95b9-4aae-bae8-2e3f92afe3ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.527480 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3da269c9-114c-4043-9980-19a3903f800e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:10.538853 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3da269c9-114c-4043-9980-19a3903f800e tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.245904 Aug 24 08:57:10.539921 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 137/281] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:10 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:10.542374 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-44b37c36-95b9-4aae-bae8-2e3f92afe3ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:10.554645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-44b37c36-95b9-4aae-bae8-2e3f92afe3ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:10.556114 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-44b37c36-95b9-4aae-bae8-2e3f92afe3ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:10.557514 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-44b37c36-95b9-4aae-bae8-2e3f92afe3ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.256907 Aug 24 08:57:10.558216 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 145/282] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:10 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:57:10.881271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-49e35d7a-8f99-4d14-8453-c3d29e2eeef1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:10.881922 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-49e35d7a-8f99-4d14-8453-c3d29e2eeef1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:10.887855 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49e35d7a-8f99-4d14-8453-c3d29e2eeef1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.888384 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49e35d7a-8f99-4d14-8453-c3d29e2eeef1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.888837 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49e35d7a-8f99-4d14-8453-c3d29e2eeef1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.889542 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49e35d7a-8f99-4d14-8453-c3d29e2eeef1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.890007 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49e35d7a-8f99-4d14-8453-c3d29e2eeef1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.890450 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49e35d7a-8f99-4d14-8453-c3d29e2eeef1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.892973 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9b0986fb-dd47-4c35-9763-b39ce445eab3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:10.893580 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9b0986fb-dd47-4c35-9763-b39ce445eab3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:10.899709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b0986fb-dd47-4c35-9763-b39ce445eab3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.900284 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b0986fb-dd47-4c35-9763-b39ce445eab3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.900742 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b0986fb-dd47-4c35-9763-b39ce445eab3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:10.901447 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b0986fb-dd47-4c35-9763-b39ce445eab3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:10.902141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b0986fb-dd47-4c35-9763-b39ce445eab3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:10.902398 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b0986fb-dd47-4c35-9763-b39ce445eab3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:11.098509 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-49e35d7a-8f99-4d14-8453-c3d29e2eeef1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:11.105936 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9b0986fb-dd47-4c35-9763-b39ce445eab3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:11.106450 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-49e35d7a-8f99-4d14-8453-c3d29e2eeef1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.229218 Aug 24 08:57:11.107060 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 138/283] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:10 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:11.111962 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ea78d983-a332-4be0-9d15-b9ec36d6e312 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:11.112611 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ea78d983-a332-4be0-9d15-b9ec36d6e312 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:11.116156 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9b0986fb-dd47-4c35-9763-b39ce445eab3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.226599 Aug 24 08:57:11.116560 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 146/284] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:10 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:11.120949 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea78d983-a332-4be0-9d15-b9ec36d6e312 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:11.121441 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea78d983-a332-4be0-9d15-b9ec36d6e312 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:11.121878 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea78d983-a332-4be0-9d15-b9ec36d6e312 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:11.122586 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea78d983-a332-4be0-9d15-b9ec36d6e312 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:11.123043 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea78d983-a332-4be0-9d15-b9ec36d6e312 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:11.123473 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ea78d983-a332-4be0-9d15-b9ec36d6e312 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:11.273751 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ea78d983-a332-4be0-9d15-b9ec36d6e312 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:11.282370 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ea78d983-a332-4be0-9d15-b9ec36d6e312 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.174252 Aug 24 08:57:11.283391 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 139/285] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:11 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:11.564115 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bbedbfa6-1d34-4f24-ae96-fe40e5af57e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:11.564775 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bbedbfa6-1d34-4f24-ae96-fe40e5af57e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:11.571701 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbedbfa6-1d34-4f24-ae96-fe40e5af57e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:11.572417 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbedbfa6-1d34-4f24-ae96-fe40e5af57e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:11.572852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbedbfa6-1d34-4f24-ae96-fe40e5af57e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:11.573551 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbedbfa6-1d34-4f24-ae96-fe40e5af57e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:11.573998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbedbfa6-1d34-4f24-ae96-fe40e5af57e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:11.574415 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bbedbfa6-1d34-4f24-ae96-fe40e5af57e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:11.585234 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ac3ffc28-992d-4446-8433-b654e26c343f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:11.585852 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ac3ffc28-992d-4446-8433-b654e26c343f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:11.592488 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac3ffc28-992d-4446-8433-b654e26c343f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:11.593055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac3ffc28-992d-4446-8433-b654e26c343f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:11.593587 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac3ffc28-992d-4446-8433-b654e26c343f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:11.595932 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac3ffc28-992d-4446-8433-b654e26c343f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:11.595932 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac3ffc28-992d-4446-8433-b654e26c343f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:11.595932 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac3ffc28-992d-4446-8433-b654e26c343f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:11.828229 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-bbedbfa6-1d34-4f24-ae96-fe40e5af57e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:11.832556 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ac3ffc28-992d-4446-8433-b654e26c343f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:11.840333 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bbedbfa6-1d34-4f24-ae96-fe40e5af57e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.278429 Aug 24 08:57:11.841886 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 147/286] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:11 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:11.844885 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ac3ffc28-992d-4446-8433-b654e26c343f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:11.847027 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ac3ffc28-992d-4446-8433-b654e26c343f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:11.849492 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ac3ffc28-992d-4446-8433-b654e26c343f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.269026 Aug 24 08:57:11.851417 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 140/287] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:11 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:57:12.129610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c479487-5501-4252-b977-b3fa93e0580b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:12.144905 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5c479487-5501-4252-b977-b3fa93e0580b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:12.150489 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-77240078-41f4-4036-8cf6-9e943e491441 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:12.151889 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c479487-5501-4252-b977-b3fa93e0580b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.152772 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-77240078-41f4-4036-8cf6-9e943e491441 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:12.153331 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c479487-5501-4252-b977-b3fa93e0580b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.154704 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c479487-5501-4252-b977-b3fa93e0580b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.155426 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c479487-5501-4252-b977-b3fa93e0580b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.155891 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c479487-5501-4252-b977-b3fa93e0580b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.156536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c479487-5501-4252-b977-b3fa93e0580b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.164563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77240078-41f4-4036-8cf6-9e943e491441 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.165327 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77240078-41f4-4036-8cf6-9e943e491441 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.166192 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77240078-41f4-4036-8cf6-9e943e491441 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.167042 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77240078-41f4-4036-8cf6-9e943e491441 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.167735 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77240078-41f4-4036-8cf6-9e943e491441 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.168237 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77240078-41f4-4036-8cf6-9e943e491441 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.381874 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c479487-5501-4252-b977-b3fa93e0580b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:12.386097 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-77240078-41f4-4036-8cf6-9e943e491441 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:12.389744 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c479487-5501-4252-b977-b3fa93e0580b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.266251 Aug 24 08:57:12.390312 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 148/288] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:12 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:12.393862 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-77240078-41f4-4036-8cf6-9e943e491441 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.249064 Aug 24 08:57:12.395297 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 141/289] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:12 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:12.396599 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d2c7a845-5c6c-4642-9fe4-3e343f0e7718 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:12.397436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d2c7a845-5c6c-4642-9fe4-3e343f0e7718 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:12.403136 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c7a845-5c6c-4642-9fe4-3e343f0e7718 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.403628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c7a845-5c6c-4642-9fe4-3e343f0e7718 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.404384 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c7a845-5c6c-4642-9fe4-3e343f0e7718 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.405117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c7a845-5c6c-4642-9fe4-3e343f0e7718 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.405576 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c7a845-5c6c-4642-9fe4-3e343f0e7718 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.406027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2c7a845-5c6c-4642-9fe4-3e343f0e7718 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.544404 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d2c7a845-5c6c-4642-9fe4-3e343f0e7718 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:12.553836 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d2c7a845-5c6c-4642-9fe4-3e343f0e7718 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.161482 Aug 24 08:57:12.553836 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 149/290] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:12 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:12.864903 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1be28ea6-ee0b-4b05-8f5a-9fe02a397787 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:12.865505 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1be28ea6-ee0b-4b05-8f5a-9fe02a397787 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:12.875568 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d0b21736-e06b-45a8-9b96-d8504cf16c2d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:12.876818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d0b21736-e06b-45a8-9b96-d8504cf16c2d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:12.885093 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1be28ea6-ee0b-4b05-8f5a-9fe02a397787 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.887342 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1be28ea6-ee0b-4b05-8f5a-9fe02a397787 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.888640 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0b21736-e06b-45a8-9b96-d8504cf16c2d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.888890 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1be28ea6-ee0b-4b05-8f5a-9fe02a397787 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.892936 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1be28ea6-ee0b-4b05-8f5a-9fe02a397787 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.893187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0b21736-e06b-45a8-9b96-d8504cf16c2d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.893780 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0b21736-e06b-45a8-9b96-d8504cf16c2d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.894784 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1be28ea6-ee0b-4b05-8f5a-9fe02a397787 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.895054 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0b21736-e06b-45a8-9b96-d8504cf16c2d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:12.895267 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1be28ea6-ee0b-4b05-8f5a-9fe02a397787 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:12.895878 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0b21736-e06b-45a8-9b96-d8504cf16c2d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:12.896484 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0b21736-e06b-45a8-9b96-d8504cf16c2d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:13.670952 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d0b21736-e06b-45a8-9b96-d8504cf16c2d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:13.681013 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d0b21736-e06b-45a8-9b96-d8504cf16c2d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:13.682678 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d0b21736-e06b-45a8-9b96-d8504cf16c2d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:13.684241 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d0b21736-e06b-45a8-9b96-d8504cf16c2d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.812356 Aug 24 08:57:13.696037 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 150/291] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:12 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:57:13.701241 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ac8ee666-1579-4da3-b593-e64e7cb30e22 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:13.701940 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ac8ee666-1579-4da3-b593-e64e7cb30e22 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:13.709637 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac8ee666-1579-4da3-b593-e64e7cb30e22 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:13.710175 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac8ee666-1579-4da3-b593-e64e7cb30e22 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:13.710601 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac8ee666-1579-4da3-b593-e64e7cb30e22 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:13.711340 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac8ee666-1579-4da3-b593-e64e7cb30e22 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:13.711803 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac8ee666-1579-4da3-b593-e64e7cb30e22 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:13.712427 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ac8ee666-1579-4da3-b593-e64e7cb30e22 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:13.717055 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:13.732702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1be28ea6-ee0b-4b05-8f5a-9fe02a397787 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:13.747054 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1be28ea6-ee0b-4b05-8f5a-9fe02a397787 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.887514 Aug 24 08:57:13.747790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 142/292] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:12 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:13.753337 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d52999ac-17fd-47a1-8f83-7ec6c06340e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:13.754927 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d52999ac-17fd-47a1-8f83-7ec6c06340e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:13.762266 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d52999ac-17fd-47a1-8f83-7ec6c06340e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:13.762767 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d52999ac-17fd-47a1-8f83-7ec6c06340e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:13.763213 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d52999ac-17fd-47a1-8f83-7ec6c06340e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:13.763921 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d52999ac-17fd-47a1-8f83-7ec6c06340e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:13.764590 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d52999ac-17fd-47a1-8f83-7ec6c06340e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:13.765028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d52999ac-17fd-47a1-8f83-7ec6c06340e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:13.949523 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ac8ee666-1579-4da3-b593-e64e7cb30e22 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:13.958654 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ac8ee666-1579-4da3-b593-e64e7cb30e22 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.261222 Aug 24 08:57:13.959252 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 151/293] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:13 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:13.962557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d52999ac-17fd-47a1-8f83-7ec6c06340e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:13.964146 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-413e28de-5087-4336-aa59-6d404ade8a18 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:13.964742 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-413e28de-5087-4336-aa59-6d404ade8a18 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:13.965019 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:13.970629 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-413e28de-5087-4336-aa59-6d404ade8a18 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:13.971149 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-413e28de-5087-4336-aa59-6d404ade8a18 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:13.971585 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-413e28de-5087-4336-aa59-6d404ade8a18 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:13.972311 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-413e28de-5087-4336-aa59-6d404ade8a18 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:13.973300 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-413e28de-5087-4336-aa59-6d404ade8a18 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:13.973441 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d52999ac-17fd-47a1-8f83-7ec6c06340e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.223403 Aug 24 08:57:13.973733 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-413e28de-5087-4336-aa59-6d404ade8a18 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:13.973909 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 143/294] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:13 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:14.106317 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-413e28de-5087-4336-aa59-6d404ade8a18 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:14.115044 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-413e28de-5087-4336-aa59-6d404ade8a18 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.154180 Aug 24 08:57:14.115652 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 152/295] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:13 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:14.707024 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-94886b8b-33df-4d90-bad6-6036e6994ae7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:14.710223 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-94886b8b-33df-4d90-bad6-6036e6994ae7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:14.725566 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94886b8b-33df-4d90-bad6-6036e6994ae7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:14.726061 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94886b8b-33df-4d90-bad6-6036e6994ae7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:14.726491 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94886b8b-33df-4d90-bad6-6036e6994ae7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:14.727398 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94886b8b-33df-4d90-bad6-6036e6994ae7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:14.728012 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94886b8b-33df-4d90-bad6-6036e6994ae7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:14.728466 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94886b8b-33df-4d90-bad6-6036e6994ae7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:14.770692 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4247b112-1dae-471e-99ef-e71de5d3e012 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:14.771609 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4247b112-1dae-471e-99ef-e71de5d3e012 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:14.777773 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4247b112-1dae-471e-99ef-e71de5d3e012 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:14.778602 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4247b112-1dae-471e-99ef-e71de5d3e012 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:14.779101 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4247b112-1dae-471e-99ef-e71de5d3e012 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:14.779951 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4247b112-1dae-471e-99ef-e71de5d3e012 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:14.780619 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4247b112-1dae-471e-99ef-e71de5d3e012 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:14.781192 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4247b112-1dae-471e-99ef-e71de5d3e012 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:14.944775 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-94886b8b-33df-4d90-bad6-6036e6994ae7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:14.961661 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-94886b8b-33df-4d90-bad6-6036e6994ae7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:14.965137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-94886b8b-33df-4d90-bad6-6036e6994ae7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:14.967344 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-94886b8b-33df-4d90-bad6-6036e6994ae7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.264087 Aug 24 08:57:14.969278 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 144/296] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:14 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:57:14.975445 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-4247b112-1dae-471e-99ef-e71de5d3e012 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:14.987526 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-82297870-dbc6-4012-8a06-c448bbcb7cb3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:14.990424 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-82297870-dbc6-4012-8a06-c448bbcb7cb3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:15.004726 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82297870-dbc6-4012-8a06-c448bbcb7cb3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:15.006671 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82297870-dbc6-4012-8a06-c448bbcb7cb3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:15.007811 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82297870-dbc6-4012-8a06-c448bbcb7cb3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:15.012149 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4247b112-1dae-471e-99ef-e71de5d3e012 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.245932 Aug 24 08:57:15.012693 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 153/297] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:14 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:15.025537 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82297870-dbc6-4012-8a06-c448bbcb7cb3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:15.025537 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82297870-dbc6-4012-8a06-c448bbcb7cb3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:15.025537 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82297870-dbc6-4012-8a06-c448bbcb7cb3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:15.030598 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-70fd1044-9193-41cd-a193-4ab7f8378fde tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:15.032353 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-70fd1044-9193-41cd-a193-4ab7f8378fde tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:15.045102 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70fd1044-9193-41cd-a193-4ab7f8378fde tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:15.045905 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70fd1044-9193-41cd-a193-4ab7f8378fde tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:15.046894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70fd1044-9193-41cd-a193-4ab7f8378fde tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:15.048371 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70fd1044-9193-41cd-a193-4ab7f8378fde tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:15.049048 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70fd1044-9193-41cd-a193-4ab7f8378fde tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:15.049649 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-70fd1044-9193-41cd-a193-4ab7f8378fde tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:15.252912 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-82297870-dbc6-4012-8a06-c448bbcb7cb3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:15.268412 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-70fd1044-9193-41cd-a193-4ab7f8378fde tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:15.279009 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-70fd1044-9193-41cd-a193-4ab7f8378fde tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.261425 Aug 24 08:57:15.279493 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 154/298] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:15 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:15.280065 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-82297870-dbc6-4012-8a06-c448bbcb7cb3 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.300521 Aug 24 08:57:15.284886 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-788770f2-24e2-47bf-beb4-e94f6425127d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:15.286163 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-788770f2-24e2-47bf-beb4-e94f6425127d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:15.292965 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788770f2-24e2-47bf-beb4-e94f6425127d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:15.293508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788770f2-24e2-47bf-beb4-e94f6425127d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:15.293937 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788770f2-24e2-47bf-beb4-e94f6425127d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:15.294634 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788770f2-24e2-47bf-beb4-e94f6425127d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:15.295088 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788770f2-24e2-47bf-beb4-e94f6425127d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:15.295500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-788770f2-24e2-47bf-beb4-e94f6425127d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:15.296643 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 145/299] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:14 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:15.447019 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-788770f2-24e2-47bf-beb4-e94f6425127d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:15.455460 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-788770f2-24e2-47bf-beb4-e94f6425127d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.174623 Aug 24 08:57:15.455854 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 155/300] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:15 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:15.998680 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8229df46-ff05-4835-a5e6-99ad60d637d6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:15.999288 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8229df46-ff05-4835-a5e6-99ad60d637d6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:16.006511 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8229df46-ff05-4835-a5e6-99ad60d637d6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:16.007283 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8229df46-ff05-4835-a5e6-99ad60d637d6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:16.007728 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8229df46-ff05-4835-a5e6-99ad60d637d6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:16.008832 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8229df46-ff05-4835-a5e6-99ad60d637d6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:16.009295 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8229df46-ff05-4835-a5e6-99ad60d637d6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:16.010126 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8229df46-ff05-4835-a5e6-99ad60d637d6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:16.042524 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-079356f2-0a61-442d-a1e0-22a44f094fbc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:16.043369 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-079356f2-0a61-442d-a1e0-22a44f094fbc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:16.060073 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079356f2-0a61-442d-a1e0-22a44f094fbc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:16.061870 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079356f2-0a61-442d-a1e0-22a44f094fbc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:16.064464 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079356f2-0a61-442d-a1e0-22a44f094fbc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:16.066200 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079356f2-0a61-442d-a1e0-22a44f094fbc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:16.066955 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079356f2-0a61-442d-a1e0-22a44f094fbc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:16.067383 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079356f2-0a61-442d-a1e0-22a44f094fbc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:16.271106 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8229df46-ff05-4835-a5e6-99ad60d637d6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:16.287404 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8229df46-ff05-4835-a5e6-99ad60d637d6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:16.290426 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8229df46-ff05-4835-a5e6-99ad60d637d6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:16.292725 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8229df46-ff05-4835-a5e6-99ad60d637d6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.298435 Aug 24 08:57:16.293690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 146/301] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:15 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:57:16.313162 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-61c2ddc4-4827-48d7-9924-a477457e6f94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:16.314033 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-61c2ddc4-4827-48d7-9924-a477457e6f94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:16.321131 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61c2ddc4-4827-48d7-9924-a477457e6f94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:16.321628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61c2ddc4-4827-48d7-9924-a477457e6f94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:16.322058 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61c2ddc4-4827-48d7-9924-a477457e6f94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:16.325828 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-079356f2-0a61-442d-a1e0-22a44f094fbc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:16.330235 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61c2ddc4-4827-48d7-9924-a477457e6f94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:16.330968 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61c2ddc4-4827-48d7-9924-a477457e6f94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:16.331401 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61c2ddc4-4827-48d7-9924-a477457e6f94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:16.335150 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-079356f2-0a61-442d-a1e0-22a44f094fbc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.296529 Aug 24 08:57:16.335737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 156/302] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:16 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:16.340823 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ed0544b-5b49-4b45-8b1d-dfba8601b708 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:16.341432 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9ed0544b-5b49-4b45-8b1d-dfba8601b708 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:16.349403 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed0544b-5b49-4b45-8b1d-dfba8601b708 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:16.350585 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed0544b-5b49-4b45-8b1d-dfba8601b708 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:16.351613 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed0544b-5b49-4b45-8b1d-dfba8601b708 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:16.353177 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed0544b-5b49-4b45-8b1d-dfba8601b708 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:16.354205 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed0544b-5b49-4b45-8b1d-dfba8601b708 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:16.354857 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed0544b-5b49-4b45-8b1d-dfba8601b708 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:16.579108 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-61c2ddc4-4827-48d7-9924-a477457e6f94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:16.596584 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ed0544b-5b49-4b45-8b1d-dfba8601b708 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:16.598561 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-61c2ddc4-4827-48d7-9924-a477457e6f94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.288897 Aug 24 08:57:16.599969 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 147/303] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:16 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:16.608523 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e326234d-8e23-4a8d-81b6-4c9850fef3da tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:16.609471 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e326234d-8e23-4a8d-81b6-4c9850fef3da tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:16.616280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ed0544b-5b49-4b45-8b1d-dfba8601b708 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.278177 Aug 24 08:57:16.617382 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e326234d-8e23-4a8d-81b6-4c9850fef3da tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:16.618148 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 157/304] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:16 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:16.618382 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e326234d-8e23-4a8d-81b6-4c9850fef3da tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:16.619066 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e326234d-8e23-4a8d-81b6-4c9850fef3da tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:16.619871 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e326234d-8e23-4a8d-81b6-4c9850fef3da tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:16.620433 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e326234d-8e23-4a8d-81b6-4c9850fef3da tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:16.620946 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e326234d-8e23-4a8d-81b6-4c9850fef3da tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:16.779255 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e326234d-8e23-4a8d-81b6-4c9850fef3da tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:16.787691 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e326234d-8e23-4a8d-81b6-4c9850fef3da tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.184372 Aug 24 08:57:16.788304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 148/305] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:16 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:17.318117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-52d11a06-fea8-412e-af91-1f1832480a7f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:17.318858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-52d11a06-fea8-412e-af91-1f1832480a7f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:17.325409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52d11a06-fea8-412e-af91-1f1832480a7f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.325895 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52d11a06-fea8-412e-af91-1f1832480a7f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.326324 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52d11a06-fea8-412e-af91-1f1832480a7f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.327024 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52d11a06-fea8-412e-af91-1f1832480a7f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.327475 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52d11a06-fea8-412e-af91-1f1832480a7f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.327893 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52d11a06-fea8-412e-af91-1f1832480a7f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.360867 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-88a6ad45-bdf1-432a-877b-40103379063b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:17.361559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-88a6ad45-bdf1-432a-877b-40103379063b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:17.372593 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88a6ad45-bdf1-432a-877b-40103379063b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.373569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88a6ad45-bdf1-432a-877b-40103379063b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.374385 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88a6ad45-bdf1-432a-877b-40103379063b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.375414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88a6ad45-bdf1-432a-877b-40103379063b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.376187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88a6ad45-bdf1-432a-877b-40103379063b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.377020 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88a6ad45-bdf1-432a-877b-40103379063b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.548980 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-52d11a06-fea8-412e-af91-1f1832480a7f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:17.558148 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-52d11a06-fea8-412e-af91-1f1832480a7f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:17.559724 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-52d11a06-fea8-412e-af91-1f1832480a7f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:17.561204 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-52d11a06-fea8-412e-af91-1f1832480a7f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.247903 Aug 24 08:57:17.561904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 158/306] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:17 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:57:17.593742 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-88a6ad45-bdf1-432a-877b-40103379063b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:17.602029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-88a6ad45-bdf1-432a-877b-40103379063b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.245540 Aug 24 08:57:17.602636 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 149/307] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:17 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:17.621642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8ce20aaf-1f10-45ba-a5ec-94d28059c5b1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:17.622199 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8ce20aaf-1f10-45ba-a5ec-94d28059c5b1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:17.630175 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ce20aaf-1f10-45ba-a5ec-94d28059c5b1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.630990 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ce20aaf-1f10-45ba-a5ec-94d28059c5b1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.633601 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ce20aaf-1f10-45ba-a5ec-94d28059c5b1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.633601 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ce20aaf-1f10-45ba-a5ec-94d28059c5b1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.633952 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ce20aaf-1f10-45ba-a5ec-94d28059c5b1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.634860 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8ce20aaf-1f10-45ba-a5ec-94d28059c5b1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.647127 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f5ed0c99-ff9a-44d7-be1a-92047697204e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:17.649182 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f5ed0c99-ff9a-44d7-be1a-92047697204e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:17.663408 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5ed0c99-ff9a-44d7-be1a-92047697204e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.664255 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5ed0c99-ff9a-44d7-be1a-92047697204e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.665087 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5ed0c99-ff9a-44d7-be1a-92047697204e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.667511 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5ed0c99-ff9a-44d7-be1a-92047697204e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.668363 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5ed0c99-ff9a-44d7-be1a-92047697204e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.669307 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f5ed0c99-ff9a-44d7-be1a-92047697204e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.893595 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8ce20aaf-1f10-45ba-a5ec-94d28059c5b1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:17.898035 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f5ed0c99-ff9a-44d7-be1a-92047697204e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:17.906399 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f5ed0c99-ff9a-44d7-be1a-92047697204e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.270784 Aug 24 08:57:17.907473 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8ce20aaf-1f10-45ba-a5ec-94d28059c5b1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.290001 Aug 24 08:57:17.908216 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 159/308] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:17 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:17.917200 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5ad780e1-f357-4960-8a62-e0f9289e56fb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:17.918041 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5ad780e1-f357-4960-8a62-e0f9289e56fb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:17.920502 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 150/309] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:17 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:17.926801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ad780e1-f357-4960-8a62-e0f9289e56fb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.927397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ad780e1-f357-4960-8a62-e0f9289e56fb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.928140 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ad780e1-f357-4960-8a62-e0f9289e56fb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:17.929521 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ad780e1-f357-4960-8a62-e0f9289e56fb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:17.930348 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ad780e1-f357-4960-8a62-e0f9289e56fb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:17.930722 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ad780e1-f357-4960-8a62-e0f9289e56fb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:18.083486 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5ad780e1-f357-4960-8a62-e0f9289e56fb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:18.091705 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5ad780e1-f357-4960-8a62-e0f9289e56fb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1363 microversion: 2.1 time: 0.181948 Aug 24 08:57:18.092333 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 160/310] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:17 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:18.588070 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-45695dcb-b391-4f3b-b1f8-0aad757f3bce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:18.588622 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-45695dcb-b391-4f3b-b1f8-0aad757f3bce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:18.594840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45695dcb-b391-4f3b-b1f8-0aad757f3bce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:18.595325 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45695dcb-b391-4f3b-b1f8-0aad757f3bce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:18.595762 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45695dcb-b391-4f3b-b1f8-0aad757f3bce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:18.596504 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45695dcb-b391-4f3b-b1f8-0aad757f3bce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:18.596924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45695dcb-b391-4f3b-b1f8-0aad757f3bce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:18.597342 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45695dcb-b391-4f3b-b1f8-0aad757f3bce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:18.623147 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-079818ab-419a-4030-ac59-aada8e8c4e95 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:18.624443 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-079818ab-419a-4030-ac59-aada8e8c4e95 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:18.630707 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079818ab-419a-4030-ac59-aada8e8c4e95 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:18.631550 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079818ab-419a-4030-ac59-aada8e8c4e95 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:18.632246 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079818ab-419a-4030-ac59-aada8e8c4e95 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:18.633293 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079818ab-419a-4030-ac59-aada8e8c4e95 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:18.633844 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079818ab-419a-4030-ac59-aada8e8c4e95 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:18.634357 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-079818ab-419a-4030-ac59-aada8e8c4e95 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:18.819911 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-45695dcb-b391-4f3b-b1f8-0aad757f3bce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:18.828921 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-079818ab-419a-4030-ac59-aada8e8c4e95 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:18.829700 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-45695dcb-b391-4f3b-b1f8-0aad757f3bce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:18.831460 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-45695dcb-b391-4f3b-b1f8-0aad757f3bce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:18.833182 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-45695dcb-b391-4f3b-b1f8-0aad757f3bce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.248707 Aug 24 08:57:18.833744 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 151/311] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:18 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:57:18.839688 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-079818ab-419a-4030-ac59-aada8e8c4e95 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.220237 Aug 24 08:57:18.840489 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 161/312] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:18 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:18.929811 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-04ba7e76-f741-4c09-80b8-c656c1c20f8e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:18.931106 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-04ba7e76-f741-4c09-80b8-c656c1c20f8e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:18.936067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4e381ec5-b543-4eed-8738-c96d0e1145c4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:18.936932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4e381ec5-b543-4eed-8738-c96d0e1145c4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:18.937257 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04ba7e76-f741-4c09-80b8-c656c1c20f8e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:18.937747 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04ba7e76-f741-4c09-80b8-c656c1c20f8e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:18.938194 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04ba7e76-f741-4c09-80b8-c656c1c20f8e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:18.938907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04ba7e76-f741-4c09-80b8-c656c1c20f8e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:18.939368 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04ba7e76-f741-4c09-80b8-c656c1c20f8e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:18.939793 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04ba7e76-f741-4c09-80b8-c656c1c20f8e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:18.943548 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e381ec5-b543-4eed-8738-c96d0e1145c4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:18.944067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e381ec5-b543-4eed-8738-c96d0e1145c4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:18.944535 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e381ec5-b543-4eed-8738-c96d0e1145c4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:18.945239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e381ec5-b543-4eed-8738-c96d0e1145c4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:18.945695 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e381ec5-b543-4eed-8738-c96d0e1145c4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:18.946112 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e381ec5-b543-4eed-8738-c96d0e1145c4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:19.158636 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-04ba7e76-f741-4c09-80b8-c656c1c20f8e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:19.165567 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-4e381ec5-b543-4eed-8738-c96d0e1145c4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:19.168026 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-04ba7e76-f741-4c09-80b8-c656c1c20f8e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.242853 Aug 24 08:57:19.168674 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 152/313] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:18 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:19.173471 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6624c950-edfd-4fa3-93c0-2f5087eb4651 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:19.174073 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6624c950-edfd-4fa3-93c0-2f5087eb4651 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:19.174586 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4e381ec5-b543-4eed-8738-c96d0e1145c4 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.242299 Aug 24 08:57:19.175343 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 162/314] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:18 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:19.186544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6624c950-edfd-4fa3-93c0-2f5087eb4651 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:19.187555 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6624c950-edfd-4fa3-93c0-2f5087eb4651 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:19.187555 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6624c950-edfd-4fa3-93c0-2f5087eb4651 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:19.188743 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6624c950-edfd-4fa3-93c0-2f5087eb4651 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:19.189075 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6624c950-edfd-4fa3-93c0-2f5087eb4651 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:19.189506 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6624c950-edfd-4fa3-93c0-2f5087eb4651 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:19.325227 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6624c950-edfd-4fa3-93c0-2f5087eb4651 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:19.333079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6624c950-edfd-4fa3-93c0-2f5087eb4651 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1550 microversion: 2.1 time: 0.163396 Aug 24 08:57:19.333765 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 153/315] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:19 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1550 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:19.354249 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-be2df276-6c40-46a0-adfc-b2bc0a3be1a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:19.354752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-be2df276-6c40-46a0-adfc-b2bc0a3be1a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:19.360824 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be2df276-6c40-46a0-adfc-b2bc0a3be1a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:19.361317 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be2df276-6c40-46a0-adfc-b2bc0a3be1a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:19.361766 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be2df276-6c40-46a0-adfc-b2bc0a3be1a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:19.362468 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be2df276-6c40-46a0-adfc-b2bc0a3be1a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:19.362922 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be2df276-6c40-46a0-adfc-b2bc0a3be1a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:19.363468 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be2df276-6c40-46a0-adfc-b2bc0a3be1a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:19.524601 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-be2df276-6c40-46a0-adfc-b2bc0a3be1a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.173942 Aug 24 08:57:19.525283 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 163/316] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 24 08:57:19 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:19.600323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-dacc5fc3-6b16-4d1e-99e6-c5fa4334457a req-d8f31f4d-c58b-4ff9-9495-a926579013e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa211fc0-831d-4d6f-863e-b44a4c49f382", "name": "network-vif-plugged", "status": "completed", "tag": "80cea5be-668b-4485-bc47-616ebf607678"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:19.612867 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dacc5fc3-6b16-4d1e-99e6-c5fa4334457a req-d8f31f4d-c58b-4ff9-9495-a926579013e3 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:19.613517 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dacc5fc3-6b16-4d1e-99e6-c5fa4334457a req-d8f31f4d-c58b-4ff9-9495-a926579013e3 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:19.614664 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-dacc5fc3-6b16-4d1e-99e6-c5fa4334457a req-d8f31f4d-c58b-4ff9-9495-a926579013e3 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:19.631602 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-dacc5fc3-6b16-4d1e-99e6-c5fa4334457a req-d8f31f4d-c58b-4ff9-9495-a926579013e3 service nova] Creating event network-vif-plugged:80cea5be-668b-4485-bc47-616ebf607678 for instance aa211fc0-831d-4d6f-863e-b44a4c49f382 on hv-cinder-83538 Aug 24 08:57:19.638076 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-dacc5fc3-6b16-4d1e-99e6-c5fa4334457a req-d8f31f4d-c58b-4ff9-9495-a926579013e3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041564 Aug 24 08:57:19.639317 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 154/317] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:19.869653 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-669318d5-5713-42f1-98d3-99894aaa2cc6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:19.870894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-669318d5-5713-42f1-98d3-99894aaa2cc6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:19.871181 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3068e194-e2c5-44f7-9549-a03c809ac5aa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:19.872639 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3068e194-e2c5-44f7-9549-a03c809ac5aa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:19.880739 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3068e194-e2c5-44f7-9549-a03c809ac5aa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:19.881398 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3068e194-e2c5-44f7-9549-a03c809ac5aa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:19.881912 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3068e194-e2c5-44f7-9549-a03c809ac5aa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:19.882415 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669318d5-5713-42f1-98d3-99894aaa2cc6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:19.882833 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3068e194-e2c5-44f7-9549-a03c809ac5aa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:19.883157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669318d5-5713-42f1-98d3-99894aaa2cc6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:19.883352 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3068e194-e2c5-44f7-9549-a03c809ac5aa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:19.884020 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669318d5-5713-42f1-98d3-99894aaa2cc6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:19.884219 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3068e194-e2c5-44f7-9549-a03c809ac5aa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:19.885056 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669318d5-5713-42f1-98d3-99894aaa2cc6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:19.885730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669318d5-5713-42f1-98d3-99894aaa2cc6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:19.886326 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-669318d5-5713-42f1-98d3-99894aaa2cc6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:20.671816 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3068e194-e2c5-44f7-9549-a03c809ac5aa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:20.680735 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-669318d5-5713-42f1-98d3-99894aaa2cc6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:20.681994 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3068e194-e2c5-44f7-9549-a03c809ac5aa tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.816742 Aug 24 08:57:20.693064 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 155/318] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:19 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:20.694120 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-669318d5-5713-42f1-98d3-99894aaa2cc6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:20.696831 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-669318d5-5713-42f1-98d3-99894aaa2cc6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:20.699164 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-669318d5-5713-42f1-98d3-99894aaa2cc6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.837691 Aug 24 08:57:20.700672 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 164/319] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:19 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:57:20.712822 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-deea5a58-2e89-4dbf-b01e-6a34d1689ee7 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:20.715278 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-deea5a58-2e89-4dbf-b01e-6a34d1689ee7 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:20.731422 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7775c356-1bc2-4ca4-9228-bbd858a62b3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:20.734243 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7775c356-1bc2-4ca4-9228-bbd858a62b3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:20.745404 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7775c356-1bc2-4ca4-9228-bbd858a62b3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:20.746463 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7775c356-1bc2-4ca4-9228-bbd858a62b3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:20.747140 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7775c356-1bc2-4ca4-9228-bbd858a62b3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:20.748077 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7775c356-1bc2-4ca4-9228-bbd858a62b3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:20.748967 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7775c356-1bc2-4ca4-9228-bbd858a62b3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:20.749656 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7775c356-1bc2-4ca4-9228-bbd858a62b3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:20.768688 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-deea5a58-2e89-4dbf-b01e-6a34d1689ee7 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:20.772130 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-deea5a58-2e89-4dbf-b01e-6a34d1689ee7 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:20.772709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-deea5a58-2e89-4dbf-b01e-6a34d1689ee7 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:20.775672 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-deea5a58-2e89-4dbf-b01e-6a34d1689ee7 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:20.776403 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-deea5a58-2e89-4dbf-b01e-6a34d1689ee7 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:20.776951 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-deea5a58-2e89-4dbf-b01e-6a34d1689ee7 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:21.087899 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7775c356-1bc2-4ca4-9228-bbd858a62b3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:21.097217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7775c356-1bc2-4ca4-9228-bbd858a62b3b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.402745 Aug 24 08:57:21.097844 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 156/320] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:20 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:21.169689 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-deea5a58-2e89-4dbf-b01e-6a34d1689ee7 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:21.179264 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-deea5a58-2e89-4dbf-b01e-6a34d1689ee7 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1315 microversion: 2.1 time: 0.476637 Aug 24 08:57:21.179902 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 165/321] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:20 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:21.512809 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-511d525a-96f0-4922-ae5b-c173aaedbd9f req-80a10287-8938-4163-9647-3927ca152229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2489f27e-e91b-4e45-8072-7b4226f576f8", "tag": "f0b3f7af-883a-42f4-9c61-d5a909fd1e9a"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:21.525206 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-511d525a-96f0-4922-ae5b-c173aaedbd9f req-80a10287-8938-4163-9647-3927ca152229 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:21.526043 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-511d525a-96f0-4922-ae5b-c173aaedbd9f req-80a10287-8938-4163-9647-3927ca152229 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:21.526782 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-511d525a-96f0-4922-ae5b-c173aaedbd9f req-80a10287-8938-4163-9647-3927ca152229 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:21.548257 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-511d525a-96f0-4922-ae5b-c173aaedbd9f req-80a10287-8938-4163-9647-3927ca152229 service nova] Creating event network-changed:f0b3f7af-883a-42f4-9c61-d5a909fd1e9a for instance 2489f27e-e91b-4e45-8072-7b4226f576f8 on hv-cinder-83538 Aug 24 08:57:21.558435 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-511d525a-96f0-4922-ae5b-c173aaedbd9f req-80a10287-8938-4163-9647-3927ca152229 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048896 Aug 24 08:57:21.559544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 157/322] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:21.709549 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-29ea7d64-69e0-45af-91e1-66e2936c4c0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:21.710773 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-29ea7d64-69e0-45af-91e1-66e2936c4c0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:21.730698 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f1847abc-28eb-4559-ac4f-56f35168f34b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:21.731308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f1847abc-28eb-4559-ac4f-56f35168f34b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:21.732872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ea7d64-69e0-45af-91e1-66e2936c4c0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:21.734968 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ea7d64-69e0-45af-91e1-66e2936c4c0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:21.735497 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ea7d64-69e0-45af-91e1-66e2936c4c0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:21.742476 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1847abc-28eb-4559-ac4f-56f35168f34b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:21.743491 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1847abc-28eb-4559-ac4f-56f35168f34b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:21.743642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ea7d64-69e0-45af-91e1-66e2936c4c0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:21.744256 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1847abc-28eb-4559-ac4f-56f35168f34b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:21.745231 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ea7d64-69e0-45af-91e1-66e2936c4c0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:21.745695 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-29ea7d64-69e0-45af-91e1-66e2936c4c0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:21.746863 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1847abc-28eb-4559-ac4f-56f35168f34b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:21.747359 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1847abc-28eb-4559-ac4f-56f35168f34b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:21.748480 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1847abc-28eb-4559-ac4f-56f35168f34b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:21.988073 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-29ea7d64-69e0-45af-91e1-66e2936c4c0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:21.996025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f1847abc-28eb-4559-ac4f-56f35168f34b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:22.000168 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-29ea7d64-69e0-45af-91e1-66e2936c4c0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.297740 Aug 24 08:57:22.007540 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 166/323] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:21 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:22.009191 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f1847abc-28eb-4559-ac4f-56f35168f34b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:22.011501 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f1847abc-28eb-4559-ac4f-56f35168f34b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:22.012694 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f1847abc-28eb-4559-ac4f-56f35168f34b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1405 microversion: 2.20 time: 0.286976 Aug 24 08:57:22.013250 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 158/324] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:21 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1405 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:57:22.120801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ca887044-63f2-4fbe-bc44-39d2534a2cbb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:22.121635 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ca887044-63f2-4fbe-bc44-39d2534a2cbb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:22.129857 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca887044-63f2-4fbe-bc44-39d2534a2cbb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:22.130989 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca887044-63f2-4fbe-bc44-39d2534a2cbb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:22.131574 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca887044-63f2-4fbe-bc44-39d2534a2cbb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:22.132503 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca887044-63f2-4fbe-bc44-39d2534a2cbb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:22.132976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca887044-63f2-4fbe-bc44-39d2534a2cbb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:22.133780 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca887044-63f2-4fbe-bc44-39d2534a2cbb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:22.208654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5d3abd23-f0c3-415d-96a8-e436db5af67b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:22.209277 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5d3abd23-f0c3-415d-96a8-e436db5af67b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:22.217273 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d3abd23-f0c3-415d-96a8-e436db5af67b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:22.218018 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d3abd23-f0c3-415d-96a8-e436db5af67b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:22.219504 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d3abd23-f0c3-415d-96a8-e436db5af67b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:22.220551 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d3abd23-f0c3-415d-96a8-e436db5af67b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:22.221922 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d3abd23-f0c3-415d-96a8-e436db5af67b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:22.222536 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d3abd23-f0c3-415d-96a8-e436db5af67b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:22.345782 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ca887044-63f2-4fbe-bc44-39d2534a2cbb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:22.355246 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ca887044-63f2-4fbe-bc44-39d2534a2cbb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.239132 Aug 24 08:57:22.355921 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 167/325] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:22 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:22.417719 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5d3abd23-f0c3-415d-96a8-e436db5af67b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:22.431425 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5d3abd23-f0c3-415d-96a8-e436db5af67b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1502 microversion: 2.1 time: 0.229571 Aug 24 08:57:22.432424 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 159/326] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:22 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1502 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:23.032913 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fe23875f-675b-4433-b9ea-c7d757ef19ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:23.033799 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fe23875f-675b-4433-b9ea-c7d757ef19ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:23.037878 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57fd1731-4703-440d-a9ee-f101dc7b3d90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:23.039222 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-57fd1731-4703-440d-a9ee-f101dc7b3d90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:23.043904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe23875f-675b-4433-b9ea-c7d757ef19ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:23.043904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe23875f-675b-4433-b9ea-c7d757ef19ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:23.043904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe23875f-675b-4433-b9ea-c7d757ef19ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:23.044704 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe23875f-675b-4433-b9ea-c7d757ef19ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:23.045163 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe23875f-675b-4433-b9ea-c7d757ef19ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:23.045921 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe23875f-675b-4433-b9ea-c7d757ef19ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:23.051002 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:23.057336 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57fd1731-4703-440d-a9ee-f101dc7b3d90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:23.058105 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57fd1731-4703-440d-a9ee-f101dc7b3d90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:23.058691 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57fd1731-4703-440d-a9ee-f101dc7b3d90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:23.059548 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57fd1731-4703-440d-a9ee-f101dc7b3d90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:23.060253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57fd1731-4703-440d-a9ee-f101dc7b3d90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:23.060755 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57fd1731-4703-440d-a9ee-f101dc7b3d90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:23.258206 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-fe23875f-675b-4433-b9ea-c7d757ef19ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:23.271332 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fe23875f-675b-4433-b9ea-c7d757ef19ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.238926 Aug 24 08:57:23.274512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 168/327] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:23 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:23.283133 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-57fd1731-4703-440d-a9ee-f101dc7b3d90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:23.304169 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-57fd1731-4703-440d-a9ee-f101dc7b3d90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:23.306941 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-57fd1731-4703-440d-a9ee-f101dc7b3d90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:23.308711 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-57fd1731-4703-440d-a9ee-f101dc7b3d90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1597 microversion: 2.20 time: 0.275634 Aug 24 08:57:23.310048 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 160/328] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:57:23 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1597 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:57:23.337154 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d72d432c-a7e8-4b55-96c0-3824857bda01 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:23.337888 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d72d432c-a7e8-4b55-96c0-3824857bda01 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:23.348006 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d72d432c-a7e8-4b55-96c0-3824857bda01 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:23.348924 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d72d432c-a7e8-4b55-96c0-3824857bda01 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:23.349263 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d72d432c-a7e8-4b55-96c0-3824857bda01 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:23.349908 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d72d432c-a7e8-4b55-96c0-3824857bda01 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:23.350410 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d72d432c-a7e8-4b55-96c0-3824857bda01 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:23.350861 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d72d432c-a7e8-4b55-96c0-3824857bda01 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:23.386742 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-512be228-f400-402c-a8aa-150fd885d89c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:23.388398 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-512be228-f400-402c-a8aa-150fd885d89c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:23.398407 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-512be228-f400-402c-a8aa-150fd885d89c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:23.399220 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-512be228-f400-402c-a8aa-150fd885d89c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:23.399828 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-512be228-f400-402c-a8aa-150fd885d89c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:23.400764 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-512be228-f400-402c-a8aa-150fd885d89c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:23.401387 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-512be228-f400-402c-a8aa-150fd885d89c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:23.402062 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-512be228-f400-402c-a8aa-150fd885d89c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:23.459062 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d72d432c-a7e8-4b55-96c0-3824857bda01 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.126746 Aug 24 08:57:23.459674 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 169/329] 10.222.0.67 () {60 vars in 1316 bytes} [Wed Aug 24 08:57:23 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:57:23.734314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-512be228-f400-402c-a8aa-150fd885d89c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:23.738337 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:23.750662 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-512be228-f400-402c-a8aa-150fd885d89c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.368717 Aug 24 08:57:23.751935 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 161/330] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:23 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:24.302777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-95ae506f-817b-4233-a82c-d6d981c3e3ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:24.303554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-95ae506f-817b-4233-a82c-d6d981c3e3ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:24.311516 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95ae506f-817b-4233-a82c-d6d981c3e3ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:24.312149 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95ae506f-817b-4233-a82c-d6d981c3e3ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:24.313005 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95ae506f-817b-4233-a82c-d6d981c3e3ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:24.313953 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95ae506f-817b-4233-a82c-d6d981c3e3ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:24.314899 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95ae506f-817b-4233-a82c-d6d981c3e3ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:24.315537 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-95ae506f-817b-4233-a82c-d6d981c3e3ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:24.575375 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-95ae506f-817b-4233-a82c-d6d981c3e3ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:24.588850 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-95ae506f-817b-4233-a82c-d6d981c3e3ea tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.291151 Aug 24 08:57:24.590706 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 170/331] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:24 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:24.775346 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-04a476d1-f463-4eab-b82f-68ed45c02949 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:24.775911 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-04a476d1-f463-4eab-b82f-68ed45c02949 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:24.784117 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04a476d1-f463-4eab-b82f-68ed45c02949 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:24.784630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04a476d1-f463-4eab-b82f-68ed45c02949 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:24.785275 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04a476d1-f463-4eab-b82f-68ed45c02949 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:24.786624 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04a476d1-f463-4eab-b82f-68ed45c02949 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:24.787605 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04a476d1-f463-4eab-b82f-68ed45c02949 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:24.788045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-04a476d1-f463-4eab-b82f-68ed45c02949 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:24.959293 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-04a476d1-f463-4eab-b82f-68ed45c02949 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:24.968997 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-04a476d1-f463-4eab-b82f-68ed45c02949 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.200156 Aug 24 08:57:24.976500 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 162/332] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:24 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:25.030349 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bfce9066-a4ca-4c6e-8490-1b99b16f494e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "210f1da3-a45b-4875-99f7-d24eaf26881a"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:25.033139 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bfce9066-a4ca-4c6e-8490-1b99b16f494e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:25.046310 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfce9066-a4ca-4c6e-8490-1b99b16f494e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:25.047076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfce9066-a4ca-4c6e-8490-1b99b16f494e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:25.047780 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfce9066-a4ca-4c6e-8490-1b99b16f494e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:25.049317 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfce9066-a4ca-4c6e-8490-1b99b16f494e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:25.051480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfce9066-a4ca-4c6e-8490-1b99b16f494e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:25.052169 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfce9066-a4ca-4c6e-8490-1b99b16f494e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:25.158028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-59f18ff9-7c01-4f4b-9b4b-13b4afe6b0ca req-b95ef7b0-4706-4551-b9ce-6c3c4e3d66c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4866e8f4-ddfe-4cee-8bcc-5db7372926f5", "tag": "4e1f25c9-676d-433c-8c1b-ae79e13a1625"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:25.172334 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-59f18ff9-7c01-4f4b-9b4b-13b4afe6b0ca req-b95ef7b0-4706-4551-b9ce-6c3c4e3d66c4 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:25.172823 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-59f18ff9-7c01-4f4b-9b4b-13b4afe6b0ca req-b95ef7b0-4706-4551-b9ce-6c3c4e3d66c4 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:25.173257 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-59f18ff9-7c01-4f4b-9b4b-13b4afe6b0ca req-b95ef7b0-4706-4551-b9ce-6c3c4e3d66c4 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:25.188008 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-59f18ff9-7c01-4f4b-9b4b-13b4afe6b0ca req-b95ef7b0-4706-4551-b9ce-6c3c4e3d66c4 service nova] Creating event network-changed:4e1f25c9-676d-433c-8c1b-ae79e13a1625 for instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 on hv-cinder-83538 Aug 24 08:57:25.198312 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-59f18ff9-7c01-4f4b-9b4b-13b4afe6b0ca req-b95ef7b0-4706-4551-b9ce-6c3c4e3d66c4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045084 Aug 24 08:57:25.199858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 163/333] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:25.612077 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e96b425d-0eaf-4378-a9a2-1d94dcbce5f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:25.612957 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e96b425d-0eaf-4378-a9a2-1d94dcbce5f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:25.625040 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e96b425d-0eaf-4378-a9a2-1d94dcbce5f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:25.626531 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e96b425d-0eaf-4378-a9a2-1d94dcbce5f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:25.628977 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e96b425d-0eaf-4378-a9a2-1d94dcbce5f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:25.630615 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e96b425d-0eaf-4378-a9a2-1d94dcbce5f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:25.631775 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e96b425d-0eaf-4378-a9a2-1d94dcbce5f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:25.634097 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e96b425d-0eaf-4378-a9a2-1d94dcbce5f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:25.916885 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e96b425d-0eaf-4378-a9a2-1d94dcbce5f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:25.937106 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e96b425d-0eaf-4378-a9a2-1d94dcbce5f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.329706 Aug 24 08:57:25.941161 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 164/334] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:25 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:26.011752 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-14dc331e-fbb7-409c-950d-ce7d096c7dc5 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:26.013661 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-14dc331e-fbb7-409c-950d-ce7d096c7dc5 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:26.026814 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14dc331e-fbb7-409c-950d-ce7d096c7dc5 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:26.027580 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14dc331e-fbb7-409c-950d-ce7d096c7dc5 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:26.028662 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14dc331e-fbb7-409c-950d-ce7d096c7dc5 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:26.030160 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14dc331e-fbb7-409c-950d-ce7d096c7dc5 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:26.030890 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14dc331e-fbb7-409c-950d-ce7d096c7dc5 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:26.031589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14dc331e-fbb7-409c-950d-ce7d096c7dc5 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:26.252808 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-14dc331e-fbb7-409c-950d-ce7d096c7dc5 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:26.260521 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-14dc331e-fbb7-409c-950d-ce7d096c7dc5 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.261747 Aug 24 08:57:26.272929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 165/335] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:25 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:26.970301 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5c83bdc4-037d-47ab-9be7-bed4c439fa35 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:26.970870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5c83bdc4-037d-47ab-9be7-bed4c439fa35 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:26.978564 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c83bdc4-037d-47ab-9be7-bed4c439fa35 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:26.979052 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c83bdc4-037d-47ab-9be7-bed4c439fa35 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:26.979482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c83bdc4-037d-47ab-9be7-bed4c439fa35 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:26.980215 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c83bdc4-037d-47ab-9be7-bed4c439fa35 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:26.980829 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c83bdc4-037d-47ab-9be7-bed4c439fa35 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:26.981627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c83bdc4-037d-47ab-9be7-bed4c439fa35 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:27.133784 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5c83bdc4-037d-47ab-9be7-bed4c439fa35 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:27.142724 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5c83bdc4-037d-47ab-9be7-bed4c439fa35 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.180255 Aug 24 08:57:27.143387 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 166/336] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:26 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:27.285080 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3fb92914-f97d-4125-bf98-e46ca74d36b4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:27.285695 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3fb92914-f97d-4125-bf98-e46ca74d36b4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:27.306499 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fb92914-f97d-4125-bf98-e46ca74d36b4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:27.307004 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fb92914-f97d-4125-bf98-e46ca74d36b4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:27.307509 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fb92914-f97d-4125-bf98-e46ca74d36b4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:27.308259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fb92914-f97d-4125-bf98-e46ca74d36b4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:27.308727 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fb92914-f97d-4125-bf98-e46ca74d36b4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:27.309155 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fb92914-f97d-4125-bf98-e46ca74d36b4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:27.624567 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3fb92914-f97d-4125-bf98-e46ca74d36b4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:27.652436 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3fb92914-f97d-4125-bf98-e46ca74d36b4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.367551 Aug 24 08:57:27.653332 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 167/337] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:27 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:28.151745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-55011e14-6d99-4a8a-afea-329fe5ca7c28 req-a8df5a16-55f8-4a91-a7da-c8b2a459255a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e52bd97-9ce6-4cc5-bd9a-3218b1a23645", "name": "network-vif-plugged", "status": "completed", "tag": "3da9d3b1-4548-4832-aac1-7c9959b42dc0"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:28.165545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-55011e14-6d99-4a8a-afea-329fe5ca7c28 req-a8df5a16-55f8-4a91-a7da-c8b2a459255a service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:28.166118 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-55011e14-6d99-4a8a-afea-329fe5ca7c28 req-a8df5a16-55f8-4a91-a7da-c8b2a459255a service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:28.166566 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-55011e14-6d99-4a8a-afea-329fe5ca7c28 req-a8df5a16-55f8-4a91-a7da-c8b2a459255a service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:28.180233 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-55011e14-6d99-4a8a-afea-329fe5ca7c28 req-a8df5a16-55f8-4a91-a7da-c8b2a459255a service nova] Creating event network-vif-plugged:3da9d3b1-4548-4832-aac1-7c9959b42dc0 for instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 on hv-cinder-83538 Aug 24 08:57:28.185685 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-55011e14-6d99-4a8a-afea-329fe5ca7c28 req-a8df5a16-55f8-4a91-a7da-c8b2a459255a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042316 Aug 24 08:57:28.186294 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 168/338] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:57:28.191482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-eab89485-93ac-47ec-8bc7-52cc6f2e3b60 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:28.192282 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-eab89485-93ac-47ec-8bc7-52cc6f2e3b60 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:28.198963 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab89485-93ac-47ec-8bc7-52cc6f2e3b60 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:28.199462 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab89485-93ac-47ec-8bc7-52cc6f2e3b60 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:28.199907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab89485-93ac-47ec-8bc7-52cc6f2e3b60 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:28.200675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab89485-93ac-47ec-8bc7-52cc6f2e3b60 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:28.201138 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab89485-93ac-47ec-8bc7-52cc6f2e3b60 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:28.201573 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-eab89485-93ac-47ec-8bc7-52cc6f2e3b60 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:28.393675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-eab89485-93ac-47ec-8bc7-52cc6f2e3b60 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:28.402424 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-eab89485-93ac-47ec-8bc7-52cc6f2e3b60 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.214875 Aug 24 08:57:28.402920 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 169/339] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:28 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:28.676109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1ee92c7f-d963-4b18-b1f1-87eeee82f312 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:28.677564 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1ee92c7f-d963-4b18-b1f1-87eeee82f312 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:28.685092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee92c7f-d963-4b18-b1f1-87eeee82f312 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:28.687590 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee92c7f-d963-4b18-b1f1-87eeee82f312 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:28.688382 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee92c7f-d963-4b18-b1f1-87eeee82f312 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:28.689793 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee92c7f-d963-4b18-b1f1-87eeee82f312 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:28.690644 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee92c7f-d963-4b18-b1f1-87eeee82f312 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:28.691417 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ee92c7f-d963-4b18-b1f1-87eeee82f312 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:28.794439 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bfce9066-a4ca-4c6e-8490-1b99b16f494e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "POST /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.767937 Aug 24 08:57:28.795145 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 171/340] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 24 08:57:25 2022] POST /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977/os-volume_attachments => generated 194 bytes in 3769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:28.903504 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1ee92c7f-d963-4b18-b1f1-87eeee82f312 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:28.911375 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1ee92c7f-d963-4b18-b1f1-87eeee82f312 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.240702 Aug 24 08:57:28.912002 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 170/341] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:28 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:29.072575 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1918730580", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452", "networks": [{"uuid": "dc3b9ee1-fd38-4cdf-8521-276bf7f9bd26"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:29.128377 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] validate_networks() for [('dc3b9ee1-fd38-4cdf-8521-276bf7f9bd26', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:57:29.423955 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-df2a269c-9fc0-4c37-bebf-bf510d18c47f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:29.424914 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-df2a269c-9fc0-4c37-bebf-bf510d18c47f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:29.432538 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df2a269c-9fc0-4c37-bebf-bf510d18c47f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:29.432936 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df2a269c-9fc0-4c37-bebf-bf510d18c47f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:29.433366 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df2a269c-9fc0-4c37-bebf-bf510d18c47f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:29.434066 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df2a269c-9fc0-4c37-bebf-bf510d18c47f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:29.434517 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df2a269c-9fc0-4c37-bebf-bf510d18c47f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:29.434935 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-df2a269c-9fc0-4c37-bebf-bf510d18c47f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:29.873132 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-df2a269c-9fc0-4c37-bebf-bf510d18c47f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:29.882111 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-df2a269c-9fc0-4c37-bebf-bf510d18c47f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.461734 Aug 24 08:57:29.882506 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 171/342] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:29 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:29.933898 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6609aa5b-1453-4cfa-8abe-b76d781637e0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:29.934598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6609aa5b-1453-4cfa-8abe-b76d781637e0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:29.940724 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6609aa5b-1453-4cfa-8abe-b76d781637e0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:29.941213 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6609aa5b-1453-4cfa-8abe-b76d781637e0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:29.941644 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6609aa5b-1453-4cfa-8abe-b76d781637e0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:29.943141 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6609aa5b-1453-4cfa-8abe-b76d781637e0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:29.943357 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6609aa5b-1453-4cfa-8abe-b76d781637e0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:29.943777 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6609aa5b-1453-4cfa-8abe-b76d781637e0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:29.947343 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:57:29.947825 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:57:29.948505 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:57:29.948913 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:57:29.949324 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:57:29.958443 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:29.958929 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:29.959399 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:29.960179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:29.960642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:29.961069 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:29.978713 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Getting quotas for project 61de8fb05c3a45de90ff3238b61452bb. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:57:29.983899 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Getting quotas for user 3095e7f94a58497c812890fa86e08eec and project 61de8fb05c3a45de90ff3238b61452bb. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:57:29.998033 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:57:30.000352 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:57:30.058463 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-09aceaca-51db-44a4-9c9d-fa7280c9e136 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.990701 Aug 24 08:57:30.060320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 172/343] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 08:57:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:57:30.076707 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2215088f-450f-4d81-83af-23295824744d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:30.077359 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2215088f-450f-4d81-83af-23295824744d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:30.108691 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6609aa5b-1453-4cfa-8abe-b76d781637e0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:30.121753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6609aa5b-1453-4cfa-8abe-b76d781637e0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1320 microversion: 2.1 time: 0.190421 Aug 24 08:57:30.137214 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 172/344] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:29 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1320 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:30.296682 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-2215088f-450f-4d81-83af-23295824744d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:30.311273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2215088f-450f-4d81-83af-23295824744d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1214 microversion: 2.1 time: 0.242674 Aug 24 08:57:30.313412 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 173/345] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:30 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1214 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:30.905151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6dc7ea07-1305-4270-9e36-c27832f8ddef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:30.905932 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6dc7ea07-1305-4270-9e36-c27832f8ddef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:30.915660 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dc7ea07-1305-4270-9e36-c27832f8ddef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:30.916487 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dc7ea07-1305-4270-9e36-c27832f8ddef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:30.917103 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dc7ea07-1305-4270-9e36-c27832f8ddef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:30.917991 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dc7ea07-1305-4270-9e36-c27832f8ddef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:30.918609 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dc7ea07-1305-4270-9e36-c27832f8ddef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:30.919193 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dc7ea07-1305-4270-9e36-c27832f8ddef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:31.091541 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6dc7ea07-1305-4270-9e36-c27832f8ddef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:31.099639 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6dc7ea07-1305-4270-9e36-c27832f8ddef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.200153 Aug 24 08:57:31.100248 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 173/346] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:30 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:31.144050 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0f2a31f6-90fb-46d6-b856-69cb83a5292b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:31.144684 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0f2a31f6-90fb-46d6-b856-69cb83a5292b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:31.153560 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f2a31f6-90fb-46d6-b856-69cb83a5292b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:31.154280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f2a31f6-90fb-46d6-b856-69cb83a5292b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:31.154714 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f2a31f6-90fb-46d6-b856-69cb83a5292b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:31.155420 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f2a31f6-90fb-46d6-b856-69cb83a5292b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:31.155875 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f2a31f6-90fb-46d6-b856-69cb83a5292b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:31.156337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f2a31f6-90fb-46d6-b856-69cb83a5292b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:31.295767 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0f2a31f6-90fb-46d6-b856-69cb83a5292b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:31.304227 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0f2a31f6-90fb-46d6-b856-69cb83a5292b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1513 microversion: 2.1 time: 0.163985 Aug 24 08:57:31.304805 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 174/347] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:31 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:31.326602 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-92a5248f-922b-42fa-8f7b-33b5943cbabb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:31.328913 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-92a5248f-922b-42fa-8f7b-33b5943cbabb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:31.334041 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a2f1261d-0521-4b7e-b980-bdfdbc9b723e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:31.334611 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a2f1261d-0521-4b7e-b980-bdfdbc9b723e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:31.336419 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92a5248f-922b-42fa-8f7b-33b5943cbabb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:31.336931 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92a5248f-922b-42fa-8f7b-33b5943cbabb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:31.337369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92a5248f-922b-42fa-8f7b-33b5943cbabb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:31.338091 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92a5248f-922b-42fa-8f7b-33b5943cbabb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:31.338549 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92a5248f-922b-42fa-8f7b-33b5943cbabb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:31.338978 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-92a5248f-922b-42fa-8f7b-33b5943cbabb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:31.340890 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2f1261d-0521-4b7e-b980-bdfdbc9b723e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:31.341387 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2f1261d-0521-4b7e-b980-bdfdbc9b723e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:31.341829 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2f1261d-0521-4b7e-b980-bdfdbc9b723e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:31.342537 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2f1261d-0521-4b7e-b980-bdfdbc9b723e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:31.342994 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2f1261d-0521-4b7e-b980-bdfdbc9b723e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:31.343422 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a2f1261d-0521-4b7e-b980-bdfdbc9b723e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:31.406304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-92a5248f-922b-42fa-8f7b-33b5943cbabb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lazy-loading 'flavor' on Instance uuid aa211fc0-831d-4d6f-863e-b44a4c49f382 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:57:31.415937 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a2f1261d-0521-4b7e-b980-bdfdbc9b723e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:31.424810 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a2f1261d-0521-4b7e-b980-bdfdbc9b723e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1210 microversion: 2.1 time: 0.095276 Aug 24 08:57:31.425395 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 175/348] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:31 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:31.673602 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-92a5248f-922b-42fa-8f7b-33b5943cbabb tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "POST /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382/action" status: 200 len: 32 microversion: 2.1 time: 0.351282 Aug 24 08:57:31.674195 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 174/349] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 24 08:57:31 2022] POST /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382/action => generated 32 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 08:57:31.685005 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-27618c51-e8e5-43b0-85ea-f6408ef45c75 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:31.685664 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-27618c51-e8e5-43b0-85ea-f6408ef45c75 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:31.687726 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:31.694782 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27618c51-e8e5-43b0-85ea-f6408ef45c75 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:31.695331 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27618c51-e8e5-43b0-85ea-f6408ef45c75 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:31.695776 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27618c51-e8e5-43b0-85ea-f6408ef45c75 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:31.696523 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27618c51-e8e5-43b0-85ea-f6408ef45c75 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:31.696990 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27618c51-e8e5-43b0-85ea-f6408ef45c75 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:31.697414 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27618c51-e8e5-43b0-85ea-f6408ef45c75 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:31.836685 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-27618c51-e8e5-43b0-85ea-f6408ef45c75 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:31.844755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-27618c51-e8e5-43b0-85ea-f6408ef45c75 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.163731 Aug 24 08:57:31.845505 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 176/350] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:31 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:32.122398 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aba9632a-8a81-4a4d-b460-4ba8d2cffbdf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:32.123023 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aba9632a-8a81-4a4d-b460-4ba8d2cffbdf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:32.129528 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba9632a-8a81-4a4d-b460-4ba8d2cffbdf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:32.130150 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba9632a-8a81-4a4d-b460-4ba8d2cffbdf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:32.130783 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba9632a-8a81-4a4d-b460-4ba8d2cffbdf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:32.131505 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba9632a-8a81-4a4d-b460-4ba8d2cffbdf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:32.131975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba9632a-8a81-4a4d-b460-4ba8d2cffbdf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:32.132431 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aba9632a-8a81-4a4d-b460-4ba8d2cffbdf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:32.274204 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-aba9632a-8a81-4a4d-b460-4ba8d2cffbdf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:32.282090 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aba9632a-8a81-4a4d-b460-4ba8d2cffbdf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.164422 Aug 24 08:57:32.282654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 175/351] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:32 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:32.446864 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d5ac2e9c-ee48-42a5-be3b-2ea1b5c32f0d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:32.447477 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d5ac2e9c-ee48-42a5-be3b-2ea1b5c32f0d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:32.454384 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5ac2e9c-ee48-42a5-be3b-2ea1b5c32f0d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:32.454856 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5ac2e9c-ee48-42a5-be3b-2ea1b5c32f0d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:32.455280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5ac2e9c-ee48-42a5-be3b-2ea1b5c32f0d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:32.456078 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5ac2e9c-ee48-42a5-be3b-2ea1b5c32f0d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:32.456555 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5ac2e9c-ee48-42a5-be3b-2ea1b5c32f0d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:32.456971 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5ac2e9c-ee48-42a5-be3b-2ea1b5c32f0d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:32.520494 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d5ac2e9c-ee48-42a5-be3b-2ea1b5c32f0d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:32.528411 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d5ac2e9c-ee48-42a5-be3b-2ea1b5c32f0d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1210 microversion: 2.1 time: 0.085276 Aug 24 08:57:32.528990 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 177/352] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:32 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:32.866696 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e5799f94-74c7-46b6-8dc2-81c3323a9640 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:32.867304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e5799f94-74c7-46b6-8dc2-81c3323a9640 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:32.873652 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5799f94-74c7-46b6-8dc2-81c3323a9640 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:32.874136 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5799f94-74c7-46b6-8dc2-81c3323a9640 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:32.874572 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5799f94-74c7-46b6-8dc2-81c3323a9640 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:32.875273 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5799f94-74c7-46b6-8dc2-81c3323a9640 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:32.875731 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5799f94-74c7-46b6-8dc2-81c3323a9640 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:32.876184 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e5799f94-74c7-46b6-8dc2-81c3323a9640 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:33.019878 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e5799f94-74c7-46b6-8dc2-81c3323a9640 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:33.027874 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e5799f94-74c7-46b6-8dc2-81c3323a9640 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.165258 Aug 24 08:57:33.028471 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 176/353] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:32 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:33.303129 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0f69c157-e942-4eaa-8258-d310ad9a2aa2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:33.304325 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0f69c157-e942-4eaa-8258-d310ad9a2aa2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:33.311056 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f69c157-e942-4eaa-8258-d310ad9a2aa2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:33.311557 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f69c157-e942-4eaa-8258-d310ad9a2aa2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:33.311994 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f69c157-e942-4eaa-8258-d310ad9a2aa2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:33.312739 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f69c157-e942-4eaa-8258-d310ad9a2aa2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:33.313201 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f69c157-e942-4eaa-8258-d310ad9a2aa2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:33.313627 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0f69c157-e942-4eaa-8258-d310ad9a2aa2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:33.452743 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0f69c157-e942-4eaa-8258-d310ad9a2aa2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:33.461172 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0f69c157-e942-4eaa-8258-d310ad9a2aa2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.162078 Aug 24 08:57:33.461737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 178/354] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:33 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:33.549598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1becb89c-9aa7-467e-82a2-e0fa3b530042 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:33.550331 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1becb89c-9aa7-467e-82a2-e0fa3b530042 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:33.553947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:33.558121 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1becb89c-9aa7-467e-82a2-e0fa3b530042 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:33.558616 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1becb89c-9aa7-467e-82a2-e0fa3b530042 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:33.559060 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1becb89c-9aa7-467e-82a2-e0fa3b530042 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:33.559765 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1becb89c-9aa7-467e-82a2-e0fa3b530042 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:33.560358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1becb89c-9aa7-467e-82a2-e0fa3b530042 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:33.560844 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1becb89c-9aa7-467e-82a2-e0fa3b530042 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:33.626145 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1becb89c-9aa7-467e-82a2-e0fa3b530042 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:33.628405 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:33.635681 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1becb89c-9aa7-467e-82a2-e0fa3b530042 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1210 microversion: 2.1 time: 0.089926 Aug 24 08:57:33.636471 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 177/355] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:33 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:34.048541 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f76915b8-498c-4cf4-b72f-0e43569a1c51 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:34.049152 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f76915b8-498c-4cf4-b72f-0e43569a1c51 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:34.055927 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f76915b8-498c-4cf4-b72f-0e43569a1c51 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:34.056455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f76915b8-498c-4cf4-b72f-0e43569a1c51 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:34.056895 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f76915b8-498c-4cf4-b72f-0e43569a1c51 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:34.057591 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f76915b8-498c-4cf4-b72f-0e43569a1c51 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:34.058050 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f76915b8-498c-4cf4-b72f-0e43569a1c51 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:34.058473 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f76915b8-498c-4cf4-b72f-0e43569a1c51 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:34.191413 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f76915b8-498c-4cf4-b72f-0e43569a1c51 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:34.200503 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f76915b8-498c-4cf4-b72f-0e43569a1c51 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.155770 Aug 24 08:57:34.201070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 179/356] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:34 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:34.482729 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f1e991f4-db87-4dd7-a50f-6a6bd19da0cb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:34.483290 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f1e991f4-db87-4dd7-a50f-6a6bd19da0cb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:34.491324 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1e991f4-db87-4dd7-a50f-6a6bd19da0cb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:34.491821 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1e991f4-db87-4dd7-a50f-6a6bd19da0cb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:34.492302 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1e991f4-db87-4dd7-a50f-6a6bd19da0cb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:34.493010 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1e991f4-db87-4dd7-a50f-6a6bd19da0cb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:34.493850 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1e991f4-db87-4dd7-a50f-6a6bd19da0cb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:34.494814 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f1e991f4-db87-4dd7-a50f-6a6bd19da0cb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:34.638132 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f1e991f4-db87-4dd7-a50f-6a6bd19da0cb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:34.647201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f1e991f4-db87-4dd7-a50f-6a6bd19da0cb tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.168505 Aug 24 08:57:34.647792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 178/357] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:34 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:34.657028 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f4d624f9-c7cb-4d39-b877-833daad069b6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:34.657640 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f4d624f9-c7cb-4d39-b877-833daad069b6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:34.665356 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d624f9-c7cb-4d39-b877-833daad069b6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:34.665852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d624f9-c7cb-4d39-b877-833daad069b6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:34.666294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d624f9-c7cb-4d39-b877-833daad069b6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:34.666999 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d624f9-c7cb-4d39-b877-833daad069b6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:34.667456 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d624f9-c7cb-4d39-b877-833daad069b6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:34.667884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d624f9-c7cb-4d39-b877-833daad069b6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:34.732551 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f4d624f9-c7cb-4d39-b877-833daad069b6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:34.744543 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f4d624f9-c7cb-4d39-b877-833daad069b6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1210 microversion: 2.1 time: 0.091016 Aug 24 08:57:34.745273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 180/358] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:34 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:35.221310 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-23f2a94c-ddb4-48e3-a67a-1927aa450599 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:35.221924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-23f2a94c-ddb4-48e3-a67a-1927aa450599 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:35.228672 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23f2a94c-ddb4-48e3-a67a-1927aa450599 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:35.229166 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23f2a94c-ddb4-48e3-a67a-1927aa450599 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:35.229608 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23f2a94c-ddb4-48e3-a67a-1927aa450599 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:35.230310 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23f2a94c-ddb4-48e3-a67a-1927aa450599 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:35.230784 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23f2a94c-ddb4-48e3-a67a-1927aa450599 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:35.231215 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23f2a94c-ddb4-48e3-a67a-1927aa450599 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:35.363304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-23f2a94c-ddb4-48e3-a67a-1927aa450599 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:35.372454 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-23f2a94c-ddb4-48e3-a67a-1927aa450599 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.154961 Aug 24 08:57:35.373068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 179/359] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:35 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:35.668608 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f2d6940d-4f2e-4961-9bd6-8d0c5d68c1ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:35.669217 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f2d6940d-4f2e-4961-9bd6-8d0c5d68c1ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:35.675652 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2d6940d-4f2e-4961-9bd6-8d0c5d68c1ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:35.676178 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2d6940d-4f2e-4961-9bd6-8d0c5d68c1ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:35.676616 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2d6940d-4f2e-4961-9bd6-8d0c5d68c1ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:35.677501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2d6940d-4f2e-4961-9bd6-8d0c5d68c1ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:35.678078 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2d6940d-4f2e-4961-9bd6-8d0c5d68c1ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:35.678509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2d6940d-4f2e-4961-9bd6-8d0c5d68c1ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:35.766763 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1d4da766-aa56-4b79-bd1e-5a40d2c0527d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:35.768088 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1d4da766-aa56-4b79-bd1e-5a40d2c0527d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:35.775442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d4da766-aa56-4b79-bd1e-5a40d2c0527d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:35.777031 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d4da766-aa56-4b79-bd1e-5a40d2c0527d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:35.777481 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d4da766-aa56-4b79-bd1e-5a40d2c0527d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:35.778187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d4da766-aa56-4b79-bd1e-5a40d2c0527d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:35.778709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d4da766-aa56-4b79-bd1e-5a40d2c0527d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:35.779062 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1d4da766-aa56-4b79-bd1e-5a40d2c0527d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:35.853137 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f2d6940d-4f2e-4961-9bd6-8d0c5d68c1ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:35.861489 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1d4da766-aa56-4b79-bd1e-5a40d2c0527d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:35.862648 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f2d6940d-4f2e-4961-9bd6-8d0c5d68c1ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.197893 Aug 24 08:57:35.863328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 181/360] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:35 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:35.870202 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1d4da766-aa56-4b79-bd1e-5a40d2c0527d tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1210 microversion: 2.1 time: 0.107970 Aug 24 08:57:35.870765 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 180/361] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:35 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:36.394277 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-86ccd3d2-65cc-4466-81f6-0c8937c97154 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:36.394919 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-86ccd3d2-65cc-4466-81f6-0c8937c97154 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:36.401226 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86ccd3d2-65cc-4466-81f6-0c8937c97154 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:36.401717 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86ccd3d2-65cc-4466-81f6-0c8937c97154 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:36.402156 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86ccd3d2-65cc-4466-81f6-0c8937c97154 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:36.402847 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86ccd3d2-65cc-4466-81f6-0c8937c97154 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:36.403346 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86ccd3d2-65cc-4466-81f6-0c8937c97154 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:36.403771 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86ccd3d2-65cc-4466-81f6-0c8937c97154 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:36.535521 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-86ccd3d2-65cc-4466-81f6-0c8937c97154 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:36.543645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-86ccd3d2-65cc-4466-81f6-0c8937c97154 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.153193 Aug 24 08:57:36.544227 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 182/362] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:36 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:36.885273 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6f77df5d-1e41-4b7b-8f31-710498a230a5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:36.885911 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6f77df5d-1e41-4b7b-8f31-710498a230a5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:36.890956 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c570d59e-bd8b-443c-901a-ffc12c097120 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:36.891655 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c570d59e-bd8b-443c-901a-ffc12c097120 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:36.891983 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f77df5d-1e41-4b7b-8f31-710498a230a5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:36.892505 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f77df5d-1e41-4b7b-8f31-710498a230a5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:36.892940 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f77df5d-1e41-4b7b-8f31-710498a230a5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:36.893643 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f77df5d-1e41-4b7b-8f31-710498a230a5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:36.894094 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f77df5d-1e41-4b7b-8f31-710498a230a5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:36.894514 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6f77df5d-1e41-4b7b-8f31-710498a230a5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:36.899058 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c570d59e-bd8b-443c-901a-ffc12c097120 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:36.899644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c570d59e-bd8b-443c-901a-ffc12c097120 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:36.900108 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c570d59e-bd8b-443c-901a-ffc12c097120 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:36.900820 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c570d59e-bd8b-443c-901a-ffc12c097120 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:36.901280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c570d59e-bd8b-443c-901a-ffc12c097120 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:36.901706 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c570d59e-bd8b-443c-901a-ffc12c097120 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:36.986330 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c570d59e-bd8b-443c-901a-ffc12c097120 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:36.995708 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c570d59e-bd8b-443c-901a-ffc12c097120 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1266 microversion: 2.1 time: 0.108577 Aug 24 08:57:36.996331 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 183/363] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:36 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:37.053661 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6f77df5d-1e41-4b7b-8f31-710498a230a5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:37.061623 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6f77df5d-1e41-4b7b-8f31-710498a230a5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1366 microversion: 2.1 time: 0.180218 Aug 24 08:57:37.062190 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 181/364] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:36 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:37.564873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1df1856a-fc3a-42ce-9981-a8d64c13e9d9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:37.565461 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1df1856a-fc3a-42ce-9981-a8d64c13e9d9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:37.572512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1df1856a-fc3a-42ce-9981-a8d64c13e9d9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:37.572998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1df1856a-fc3a-42ce-9981-a8d64c13e9d9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:37.573430 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1df1856a-fc3a-42ce-9981-a8d64c13e9d9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:37.574114 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1df1856a-fc3a-42ce-9981-a8d64c13e9d9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:37.574568 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1df1856a-fc3a-42ce-9981-a8d64c13e9d9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:37.574986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1df1856a-fc3a-42ce-9981-a8d64c13e9d9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:37.715942 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1df1856a-fc3a-42ce-9981-a8d64c13e9d9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:37.723942 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1df1856a-fc3a-42ce-9981-a8d64c13e9d9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.163041 Aug 24 08:57:37.724961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 184/365] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:37 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:38.016761 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d322ea2c-223f-4e70-86c3-c5be60794b00 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:38.017452 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d322ea2c-223f-4e70-86c3-c5be60794b00 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:38.024752 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d322ea2c-223f-4e70-86c3-c5be60794b00 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:38.025195 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d322ea2c-223f-4e70-86c3-c5be60794b00 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:38.025793 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d322ea2c-223f-4e70-86c3-c5be60794b00 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:38.026554 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d322ea2c-223f-4e70-86c3-c5be60794b00 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:38.027071 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d322ea2c-223f-4e70-86c3-c5be60794b00 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:38.027529 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d322ea2c-223f-4e70-86c3-c5be60794b00 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:38.085172 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-61e2ba93-e62e-43d8-a76c-2a93c9e8810a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:38.085971 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-61e2ba93-e62e-43d8-a76c-2a93c9e8810a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:38.092916 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61e2ba93-e62e-43d8-a76c-2a93c9e8810a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:38.093545 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61e2ba93-e62e-43d8-a76c-2a93c9e8810a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:38.094477 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61e2ba93-e62e-43d8-a76c-2a93c9e8810a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:38.095429 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61e2ba93-e62e-43d8-a76c-2a93c9e8810a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:38.096129 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61e2ba93-e62e-43d8-a76c-2a93c9e8810a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:38.096906 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-61e2ba93-e62e-43d8-a76c-2a93c9e8810a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:38.098893 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d322ea2c-223f-4e70-86c3-c5be60794b00 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:38.112022 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d322ea2c-223f-4e70-86c3-c5be60794b00 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1274 microversion: 2.1 time: 0.098815 Aug 24 08:57:38.113268 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 182/366] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:38 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:38.118296 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:38.264130 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-61e2ba93-e62e-43d8-a76c-2a93c9e8810a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:38.273244 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-61e2ba93-e62e-43d8-a76c-2a93c9e8810a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1554 microversion: 2.1 time: 0.192885 Aug 24 08:57:38.273864 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 185/367] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:38 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:38.296918 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6e1a4a2c-9656-4f27-8468-a5d1b73028d1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:38.297427 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6e1a4a2c-9656-4f27-8468-a5d1b73028d1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:38.304387 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e1a4a2c-9656-4f27-8468-a5d1b73028d1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:38.305131 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e1a4a2c-9656-4f27-8468-a5d1b73028d1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:38.305572 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e1a4a2c-9656-4f27-8468-a5d1b73028d1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:38.306471 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e1a4a2c-9656-4f27-8468-a5d1b73028d1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:38.306939 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e1a4a2c-9656-4f27-8468-a5d1b73028d1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:38.307370 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6e1a4a2c-9656-4f27-8468-a5d1b73028d1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:38.424733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6e1a4a2c-9656-4f27-8468-a5d1b73028d1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132341 Aug 24 08:57:38.425929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 183/368] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 24 08:57:38 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:38.747055 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-aa8dc2a7-e66d-4837-b800-74955e3344bd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:38.747202 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-aa8dc2a7-e66d-4837-b800-74955e3344bd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:38.753873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa8dc2a7-e66d-4837-b800-74955e3344bd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:38.754648 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa8dc2a7-e66d-4837-b800-74955e3344bd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:38.755349 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa8dc2a7-e66d-4837-b800-74955e3344bd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:38.756324 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa8dc2a7-e66d-4837-b800-74955e3344bd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:38.757303 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa8dc2a7-e66d-4837-b800-74955e3344bd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:38.758078 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa8dc2a7-e66d-4837-b800-74955e3344bd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:38.981623 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-aa8dc2a7-e66d-4837-b800-74955e3344bd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:38.993429 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-aa8dc2a7-e66d-4837-b800-74955e3344bd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.251574 Aug 24 08:57:38.994694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 186/369] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:38 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:39.136087 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0e5234b9-3900-4cdd-ac22-18f7a5fd048e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:39.136865 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0e5234b9-3900-4cdd-ac22-18f7a5fd048e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:39.143142 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e5234b9-3900-4cdd-ac22-18f7a5fd048e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:39.143636 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e5234b9-3900-4cdd-ac22-18f7a5fd048e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:39.144072 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e5234b9-3900-4cdd-ac22-18f7a5fd048e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:39.144811 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e5234b9-3900-4cdd-ac22-18f7a5fd048e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:39.145398 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e5234b9-3900-4cdd-ac22-18f7a5fd048e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:39.145996 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0e5234b9-3900-4cdd-ac22-18f7a5fd048e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:39.220543 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0e5234b9-3900-4cdd-ac22-18f7a5fd048e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:39.232817 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0e5234b9-3900-4cdd-ac22-18f7a5fd048e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1284 microversion: 2.1 time: 0.100711 Aug 24 08:57:39.233412 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 184/370] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:39 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:39.973336 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:39.980672 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c7774fe3-d079-401b-bb1f-0385ab9b3617 req-49e42679-d0e7-4144-9bbf-22ffe1f1e06e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e52bd97-9ce6-4cc5-bd9a-3218b1a23645", "tag": "3da9d3b1-4548-4832-aac1-7c9959b42dc0"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:39.994409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c7774fe3-d079-401b-bb1f-0385ab9b3617 req-49e42679-d0e7-4144-9bbf-22ffe1f1e06e service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:39.995222 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c7774fe3-d079-401b-bb1f-0385ab9b3617 req-49e42679-d0e7-4144-9bbf-22ffe1f1e06e service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:39.995659 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c7774fe3-d079-401b-bb1f-0385ab9b3617 req-49e42679-d0e7-4144-9bbf-22ffe1f1e06e service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:40.012672 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c7774fe3-d079-401b-bb1f-0385ab9b3617 req-49e42679-d0e7-4144-9bbf-22ffe1f1e06e service nova] Creating event network-changed:3da9d3b1-4548-4832-aac1-7c9959b42dc0 for instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 on hv-cinder-83538 Aug 24 08:57:40.016774 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9938f80a-eeba-48e5-95f8-2d0635863d9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:40.017429 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9938f80a-eeba-48e5-95f8-2d0635863d9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:40.023334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c7774fe3-d079-401b-bb1f-0385ab9b3617 req-49e42679-d0e7-4144-9bbf-22ffe1f1e06e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050418 Aug 24 08:57:40.024769 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 187/371] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:57:40.033403 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9938f80a-eeba-48e5-95f8-2d0635863d9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:40.034002 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9938f80a-eeba-48e5-95f8-2d0635863d9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:40.034451 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9938f80a-eeba-48e5-95f8-2d0635863d9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:40.035727 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9938f80a-eeba-48e5-95f8-2d0635863d9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:40.036223 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9938f80a-eeba-48e5-95f8-2d0635863d9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:40.037350 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9938f80a-eeba-48e5-95f8-2d0635863d9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:40.223775 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9938f80a-eeba-48e5-95f8-2d0635863d9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:40.232674 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9938f80a-eeba-48e5-95f8-2d0635863d9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.219874 Aug 24 08:57:40.233555 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 185/372] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:40 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:40.258774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-20ae1b1a-faf5-456c-ac4c-26b992f2b509 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:40.259396 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-20ae1b1a-faf5-456c-ac4c-26b992f2b509 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:40.266615 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20ae1b1a-faf5-456c-ac4c-26b992f2b509 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:40.267363 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20ae1b1a-faf5-456c-ac4c-26b992f2b509 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:40.268310 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20ae1b1a-faf5-456c-ac4c-26b992f2b509 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:40.269327 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20ae1b1a-faf5-456c-ac4c-26b992f2b509 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:40.269967 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20ae1b1a-faf5-456c-ac4c-26b992f2b509 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:40.270539 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-20ae1b1a-faf5-456c-ac4c-26b992f2b509 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:40.323018 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:40.529848 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-20ae1b1a-faf5-456c-ac4c-26b992f2b509 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:40.541448 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-20ae1b1a-faf5-456c-ac4c-26b992f2b509 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1284 microversion: 2.1 time: 0.287004 Aug 24 08:57:40.556129 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 188/373] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:40 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1284 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:41.259935 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-508dd536-e351-4fe1-8527-193778a4c231 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:41.260644 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-508dd536-e351-4fe1-8527-193778a4c231 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:41.300778 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-508dd536-e351-4fe1-8527-193778a4c231 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:41.301298 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-508dd536-e351-4fe1-8527-193778a4c231 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:41.301745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-508dd536-e351-4fe1-8527-193778a4c231 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:41.306254 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-508dd536-e351-4fe1-8527-193778a4c231 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:41.306752 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-508dd536-e351-4fe1-8527-193778a4c231 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:41.309613 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-508dd536-e351-4fe1-8527-193778a4c231 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:41.570351 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-65cbcfe3-3c5d-4f45-9a55-c87c1d49070e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:41.574469 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-65cbcfe3-3c5d-4f45-9a55-c87c1d49070e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:41.618103 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65cbcfe3-3c5d-4f45-9a55-c87c1d49070e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:41.619333 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65cbcfe3-3c5d-4f45-9a55-c87c1d49070e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:41.622513 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65cbcfe3-3c5d-4f45-9a55-c87c1d49070e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:41.624379 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65cbcfe3-3c5d-4f45-9a55-c87c1d49070e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:41.629431 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65cbcfe3-3c5d-4f45-9a55-c87c1d49070e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:41.631355 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-65cbcfe3-3c5d-4f45-9a55-c87c1d49070e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:41.802826 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-65cbcfe3-3c5d-4f45-9a55-c87c1d49070e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:41.820475 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-65cbcfe3-3c5d-4f45-9a55-c87c1d49070e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1272 microversion: 2.1 time: 0.255444 Aug 24 08:57:41.821979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 189/374] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:41 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1272 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:41.853536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d87a71c7-18bc-4f23-9c28-60d0540b52fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:41.855107 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d87a71c7-18bc-4f23-9c28-60d0540b52fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:41.864397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87a71c7-18bc-4f23-9c28-60d0540b52fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:41.865638 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87a71c7-18bc-4f23-9c28-60d0540b52fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:41.866351 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87a71c7-18bc-4f23-9c28-60d0540b52fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:41.867401 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87a71c7-18bc-4f23-9c28-60d0540b52fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:41.868045 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87a71c7-18bc-4f23-9c28-60d0540b52fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:41.868855 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87a71c7-18bc-4f23-9c28-60d0540b52fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:41.905263 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d87a71c7-18bc-4f23-9c28-60d0540b52fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:57:41.992077 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-508dd536-e351-4fe1-8527-193778a4c231 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:42.008143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-508dd536-e351-4fe1-8527-193778a4c231 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.753608 Aug 24 08:57:42.009188 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 186/375] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:41 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:42.110212 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d87a71c7-18bc-4f23-9c28-60d0540b52fb tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 204 len: 0 microversion: 2.1 time: 0.261657 Aug 24 08:57:42.114736 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 190/376] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 08:57:41 2022] DELETE /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:57:42.120605 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-006e8f8b-baff-47b1-83b4-8847ec0d124e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:42.121238 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-006e8f8b-baff-47b1-83b4-8847ec0d124e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:42.133029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-006e8f8b-baff-47b1-83b4-8847ec0d124e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:42.134229 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-006e8f8b-baff-47b1-83b4-8847ec0d124e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:42.135731 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-006e8f8b-baff-47b1-83b4-8847ec0d124e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:42.137942 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-006e8f8b-baff-47b1-83b4-8847ec0d124e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:42.139128 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-006e8f8b-baff-47b1-83b4-8847ec0d124e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:42.141010 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-006e8f8b-baff-47b1-83b4-8847ec0d124e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:42.595534 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-006e8f8b-baff-47b1-83b4-8847ec0d124e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:42.605867 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-006e8f8b-baff-47b1-83b4-8847ec0d124e tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1554 microversion: 2.1 time: 0.489447 Aug 24 08:57:42.607902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 187/377] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:42 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1554 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:42.853252 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-06a7ab90-9403-4f06-8a4e-19eb6119ed55 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:42.854154 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-06a7ab90-9403-4f06-8a4e-19eb6119ed55 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:42.861845 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06a7ab90-9403-4f06-8a4e-19eb6119ed55 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:42.863270 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06a7ab90-9403-4f06-8a4e-19eb6119ed55 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:42.863818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06a7ab90-9403-4f06-8a4e-19eb6119ed55 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:42.864805 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06a7ab90-9403-4f06-8a4e-19eb6119ed55 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:42.866140 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06a7ab90-9403-4f06-8a4e-19eb6119ed55 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:42.866744 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06a7ab90-9403-4f06-8a4e-19eb6119ed55 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:43.029470 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-014c7a5e-f122-4325-83ff-fbbce5bf62b6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:43.030090 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-014c7a5e-f122-4325-83ff-fbbce5bf62b6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:43.036049 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-014c7a5e-f122-4325-83ff-fbbce5bf62b6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:43.036634 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-014c7a5e-f122-4325-83ff-fbbce5bf62b6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:43.037544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-014c7a5e-f122-4325-83ff-fbbce5bf62b6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:43.038253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-014c7a5e-f122-4325-83ff-fbbce5bf62b6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:43.038715 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-014c7a5e-f122-4325-83ff-fbbce5bf62b6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:43.039136 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-014c7a5e-f122-4325-83ff-fbbce5bf62b6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:43.223334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-06a7ab90-9403-4f06-8a4e-19eb6119ed55 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:43.228127 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-06a7ab90-9403-4f06-8a4e-19eb6119ed55 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1314 microversion: 2.1 time: 0.379563 Aug 24 08:57:43.229451 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 191/378] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:42 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:43.263175 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-014c7a5e-f122-4325-83ff-fbbce5bf62b6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:43.272508 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-014c7a5e-f122-4325-83ff-fbbce5bf62b6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.246070 Aug 24 08:57:43.273432 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 188/379] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:43 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:43.628865 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a03f400b-c5f6-4173-8d1b-2e98e52a35b5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:43.629470 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a03f400b-c5f6-4173-8d1b-2e98e52a35b5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:43.636492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a03f400b-c5f6-4173-8d1b-2e98e52a35b5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:43.636978 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a03f400b-c5f6-4173-8d1b-2e98e52a35b5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:43.637412 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a03f400b-c5f6-4173-8d1b-2e98e52a35b5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:43.638136 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a03f400b-c5f6-4173-8d1b-2e98e52a35b5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:43.638570 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a03f400b-c5f6-4173-8d1b-2e98e52a35b5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:43.638992 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a03f400b-c5f6-4173-8d1b-2e98e52a35b5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:43.780959 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a03f400b-c5f6-4173-8d1b-2e98e52a35b5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:43.789429 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a03f400b-c5f6-4173-8d1b-2e98e52a35b5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1554 microversion: 2.1 time: 0.164564 Aug 24 08:57:43.790381 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 192/380] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:43 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:44.252370 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7b0afc7b-d7d1-453e-b073-9188b8f46734 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:44.253085 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7b0afc7b-d7d1-453e-b073-9188b8f46734 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:44.260185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b0afc7b-d7d1-453e-b073-9188b8f46734 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:44.260952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b0afc7b-d7d1-453e-b073-9188b8f46734 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:44.261308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b0afc7b-d7d1-453e-b073-9188b8f46734 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:44.262088 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b0afc7b-d7d1-453e-b073-9188b8f46734 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:44.262610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b0afc7b-d7d1-453e-b073-9188b8f46734 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:44.263105 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b0afc7b-d7d1-453e-b073-9188b8f46734 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:44.300842 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-78903fd8-c81a-40b9-b252-313dca740f8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:44.301478 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-78903fd8-c81a-40b9-b252-313dca740f8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:44.311183 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78903fd8-c81a-40b9-b252-313dca740f8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:44.311183 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78903fd8-c81a-40b9-b252-313dca740f8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:44.311183 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78903fd8-c81a-40b9-b252-313dca740f8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:44.311747 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78903fd8-c81a-40b9-b252-313dca740f8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:44.312414 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78903fd8-c81a-40b9-b252-313dca740f8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:44.312853 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-78903fd8-c81a-40b9-b252-313dca740f8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:44.483020 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7b0afc7b-d7d1-453e-b073-9188b8f46734 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:44.495933 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7b0afc7b-d7d1-453e-b073-9188b8f46734 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1314 microversion: 2.1 time: 0.247259 Aug 24 08:57:44.496525 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 189/381] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:44 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:44.518596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-78903fd8-c81a-40b9-b252-313dca740f8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:44.530148 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-78903fd8-c81a-40b9-b252-313dca740f8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.235471 Aug 24 08:57:44.531195 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 193/382] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:44 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:44.811042 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-023abd8a-5527-4742-bb57-b9fe9f46c98f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:44.811926 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-023abd8a-5527-4742-bb57-b9fe9f46c98f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:44.819745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023abd8a-5527-4742-bb57-b9fe9f46c98f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:44.820209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023abd8a-5527-4742-bb57-b9fe9f46c98f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:44.820717 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023abd8a-5527-4742-bb57-b9fe9f46c98f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:44.821850 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023abd8a-5527-4742-bb57-b9fe9f46c98f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:44.822116 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023abd8a-5527-4742-bb57-b9fe9f46c98f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:44.822534 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023abd8a-5527-4742-bb57-b9fe9f46c98f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:45.098439 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-023abd8a-5527-4742-bb57-b9fe9f46c98f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:45.109654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-023abd8a-5527-4742-bb57-b9fe9f46c98f tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1554 microversion: 2.1 time: 0.302505 Aug 24 08:57:45.110254 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 190/383] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:44 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1554 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:45.528060 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-932ed44b-716f-41e5-a5d8-072d426b2212 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:45.530132 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-932ed44b-716f-41e5-a5d8-072d426b2212 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:45.541822 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-932ed44b-716f-41e5-a5d8-072d426b2212 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:45.542702 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-932ed44b-716f-41e5-a5d8-072d426b2212 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:45.543283 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-932ed44b-716f-41e5-a5d8-072d426b2212 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:45.544246 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-932ed44b-716f-41e5-a5d8-072d426b2212 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:45.545004 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-932ed44b-716f-41e5-a5d8-072d426b2212 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:45.545737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-932ed44b-716f-41e5-a5d8-072d426b2212 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:45.572426 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e76b025e-0023-40a5-82c9-86479d6c5504 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:45.574711 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e76b025e-0023-40a5-82c9-86479d6c5504 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:45.590832 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e76b025e-0023-40a5-82c9-86479d6c5504 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:45.591443 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e76b025e-0023-40a5-82c9-86479d6c5504 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:45.592289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e76b025e-0023-40a5-82c9-86479d6c5504 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:45.593674 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e76b025e-0023-40a5-82c9-86479d6c5504 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:45.594512 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e76b025e-0023-40a5-82c9-86479d6c5504 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:45.595300 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e76b025e-0023-40a5-82c9-86479d6c5504 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:45.868588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-932ed44b-716f-41e5-a5d8-072d426b2212 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:45.873186 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e76b025e-0023-40a5-82c9-86479d6c5504 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:45.879620 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-932ed44b-716f-41e5-a5d8-072d426b2212 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1314 microversion: 2.1 time: 0.361905 Aug 24 08:57:45.880958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 194/384] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:45 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:45.883560 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e76b025e-0023-40a5-82c9-86479d6c5504 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.319482 Aug 24 08:57:45.884297 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 191/385] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:45 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:45.892056 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-970a52a7-02aa-4fc0-8a47-bde484948fe1 req-c37d161c-d9e5-4420-a976-b72a512f1642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deef385e-6b4c-4800-b1c5-5620d0f0f56f", "tag": "05f06d68-8ebb-4a09-92d8-7e73fa276d34"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:45.902176 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-970a52a7-02aa-4fc0-8a47-bde484948fe1 req-c37d161c-d9e5-4420-a976-b72a512f1642 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:45.902663 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-970a52a7-02aa-4fc0-8a47-bde484948fe1 req-c37d161c-d9e5-4420-a976-b72a512f1642 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:45.903230 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-970a52a7-02aa-4fc0-8a47-bde484948fe1 req-c37d161c-d9e5-4420-a976-b72a512f1642 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:45.920343 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-970a52a7-02aa-4fc0-8a47-bde484948fe1 req-c37d161c-d9e5-4420-a976-b72a512f1642 service nova] Creating event network-changed:05f06d68-8ebb-4a09-92d8-7e73fa276d34 for instance deef385e-6b4c-4800-b1c5-5620d0f0f56f on hv-cinder-83538 Aug 24 08:57:45.927021 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-970a52a7-02aa-4fc0-8a47-bde484948fe1 req-c37d161c-d9e5-4420-a976-b72a512f1642 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044177 Aug 24 08:57:45.928149 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 195/386] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:46.132048 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b68ad38b-e7d0-44cd-9e66-5c8845557390 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:46.132862 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b68ad38b-e7d0-44cd-9e66-5c8845557390 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:46.139091 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68ad38b-e7d0-44cd-9e66-5c8845557390 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:46.139585 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68ad38b-e7d0-44cd-9e66-5c8845557390 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:46.140025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68ad38b-e7d0-44cd-9e66-5c8845557390 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:46.140801 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68ad38b-e7d0-44cd-9e66-5c8845557390 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:46.141261 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68ad38b-e7d0-44cd-9e66-5c8845557390 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:46.141709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b68ad38b-e7d0-44cd-9e66-5c8845557390 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:46.304676 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b68ad38b-e7d0-44cd-9e66-5c8845557390 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:46.315866 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b68ad38b-e7d0-44cd-9e66-5c8845557390 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1554 microversion: 2.1 time: 0.188152 Aug 24 08:57:46.316576 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 192/387] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:46 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:46.915481 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-09b588e7-dd1d-488b-9220-7e579e44c307 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:46.916300 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-09b588e7-dd1d-488b-9220-7e579e44c307 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:46.916414 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d0224b7a-1f1c-41ec-b7ad-413acb5fd82b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:46.917040 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d0224b7a-1f1c-41ec-b7ad-413acb5fd82b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:46.922838 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09b588e7-dd1d-488b-9220-7e579e44c307 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:46.923432 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0224b7a-1f1c-41ec-b7ad-413acb5fd82b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:46.923553 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09b588e7-dd1d-488b-9220-7e579e44c307 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:46.923946 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0224b7a-1f1c-41ec-b7ad-413acb5fd82b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:46.924145 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09b588e7-dd1d-488b-9220-7e579e44c307 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:46.924423 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0224b7a-1f1c-41ec-b7ad-413acb5fd82b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:46.924741 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09b588e7-dd1d-488b-9220-7e579e44c307 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:46.925204 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09b588e7-dd1d-488b-9220-7e579e44c307 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:46.925316 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0224b7a-1f1c-41ec-b7ad-413acb5fd82b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:46.925684 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0224b7a-1f1c-41ec-b7ad-413acb5fd82b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:46.925797 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09b588e7-dd1d-488b-9220-7e579e44c307 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:46.926135 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d0224b7a-1f1c-41ec-b7ad-413acb5fd82b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:47.140559 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d0224b7a-1f1c-41ec-b7ad-413acb5fd82b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:47.145859 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-09b588e7-dd1d-488b-9220-7e579e44c307 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:47.149187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d0224b7a-1f1c-41ec-b7ad-413acb5fd82b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1314 microversion: 2.1 time: 0.238191 Aug 24 08:57:47.149767 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 196/388] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:46 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:47.155608 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-09b588e7-dd1d-488b-9220-7e579e44c307 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.244639 Aug 24 08:57:47.156565 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 193/389] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:46 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:47.337961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ff83f5de-d237-4da0-8e9f-5085f572d21b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:47.338599 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ff83f5de-d237-4da0-8e9f-5085f572d21b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:47.344880 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff83f5de-d237-4da0-8e9f-5085f572d21b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:47.345381 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff83f5de-d237-4da0-8e9f-5085f572d21b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:47.345823 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff83f5de-d237-4da0-8e9f-5085f572d21b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:47.346530 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff83f5de-d237-4da0-8e9f-5085f572d21b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:47.346989 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff83f5de-d237-4da0-8e9f-5085f572d21b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:47.347426 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff83f5de-d237-4da0-8e9f-5085f572d21b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:47.506728 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ff83f5de-d237-4da0-8e9f-5085f572d21b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:47.515258 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ff83f5de-d237-4da0-8e9f-5085f572d21b tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1554 microversion: 2.1 time: 0.181325 Aug 24 08:57:47.515834 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 197/390] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:47 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:48.170504 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c56a02e1-5530-4cba-ac53-3a434e91c18f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:48.171111 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c56a02e1-5530-4cba-ac53-3a434e91c18f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:48.177209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c56a02e1-5530-4cba-ac53-3a434e91c18f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:48.178008 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c56a02e1-5530-4cba-ac53-3a434e91c18f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:48.178156 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c56a02e1-5530-4cba-ac53-3a434e91c18f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:48.178274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4af78ccd-f828-4855-af4e-ead2d3820fb4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:48.178894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4af78ccd-f828-4855-af4e-ead2d3820fb4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:48.178987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c56a02e1-5530-4cba-ac53-3a434e91c18f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:48.179232 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c56a02e1-5530-4cba-ac53-3a434e91c18f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:48.179653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c56a02e1-5530-4cba-ac53-3a434e91c18f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:48.185383 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4af78ccd-f828-4855-af4e-ead2d3820fb4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:48.185902 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4af78ccd-f828-4855-af4e-ead2d3820fb4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:48.186337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4af78ccd-f828-4855-af4e-ead2d3820fb4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:48.187040 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4af78ccd-f828-4855-af4e-ead2d3820fb4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:48.187565 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4af78ccd-f828-4855-af4e-ead2d3820fb4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:48.188000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4af78ccd-f828-4855-af4e-ead2d3820fb4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:48.387718 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c56a02e1-5530-4cba-ac53-3a434e91c18f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:48.390075 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:48.390622 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-4af78ccd-f828-4855-af4e-ead2d3820fb4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:48.397828 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c56a02e1-5530-4cba-ac53-3a434e91c18f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1314 microversion: 2.1 time: 0.231212 Aug 24 08:57:48.399225 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4af78ccd-f828-4855-af4e-ead2d3820fb4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.225096 Aug 24 08:57:48.403925 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 194/391] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:48 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:48.404693 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 198/392] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:48 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:48.535994 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-224a9c2e-d5f1-43b6-92cc-df6843b5000a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:48.536643 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-224a9c2e-d5f1-43b6-92cc-df6843b5000a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:48.543148 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-224a9c2e-d5f1-43b6-92cc-df6843b5000a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:48.543644 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-224a9c2e-d5f1-43b6-92cc-df6843b5000a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:48.544125 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-224a9c2e-d5f1-43b6-92cc-df6843b5000a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:48.544853 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-224a9c2e-d5f1-43b6-92cc-df6843b5000a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:48.545313 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-224a9c2e-d5f1-43b6-92cc-df6843b5000a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:48.545735 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-224a9c2e-d5f1-43b6-92cc-df6843b5000a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:48.868797 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-224a9c2e-d5f1-43b6-92cc-df6843b5000a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:48.879760 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-224a9c2e-d5f1-43b6-92cc-df6843b5000a tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1554 microversion: 2.1 time: 0.347432 Aug 24 08:57:48.880388 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 195/393] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:48 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1554 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:49.420856 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-85694170-2193-48b9-8b35-f467ba71fa3c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:49.426632 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-587976a3-871f-4c4d-b95c-6f1d027d9fbf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:49.427338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-587976a3-871f-4c4d-b95c-6f1d027d9fbf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:49.427954 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-85694170-2193-48b9-8b35-f467ba71fa3c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:49.439630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-587976a3-871f-4c4d-b95c-6f1d027d9fbf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:49.440291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-587976a3-871f-4c4d-b95c-6f1d027d9fbf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:49.440787 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-587976a3-871f-4c4d-b95c-6f1d027d9fbf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:49.441780 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-587976a3-871f-4c4d-b95c-6f1d027d9fbf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:49.442490 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-587976a3-871f-4c4d-b95c-6f1d027d9fbf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:49.443618 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85694170-2193-48b9-8b35-f467ba71fa3c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:49.443989 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85694170-2193-48b9-8b35-f467ba71fa3c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:49.444141 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-587976a3-871f-4c4d-b95c-6f1d027d9fbf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:49.444782 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85694170-2193-48b9-8b35-f467ba71fa3c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:49.446969 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85694170-2193-48b9-8b35-f467ba71fa3c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:49.447731 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85694170-2193-48b9-8b35-f467ba71fa3c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:49.448816 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85694170-2193-48b9-8b35-f467ba71fa3c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:49.678331 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-587976a3-871f-4c4d-b95c-6f1d027d9fbf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:49.687469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-587976a3-871f-4c4d-b95c-6f1d027d9fbf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.264596 Aug 24 08:57:49.688044 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 196/394] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:49 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:49.712561 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-85694170-2193-48b9-8b35-f467ba71fa3c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:49.720804 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-85694170-2193-48b9-8b35-f467ba71fa3c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1314 microversion: 2.1 time: 0.303715 Aug 24 08:57:49.721518 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 199/395] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:49 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:49.902246 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-136c0903-fcc0-449e-8755-f0ee465300d1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:49.902916 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-136c0903-fcc0-449e-8755-f0ee465300d1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:49.909084 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-136c0903-fcc0-449e-8755-f0ee465300d1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:49.909576 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-136c0903-fcc0-449e-8755-f0ee465300d1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:49.910021 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-136c0903-fcc0-449e-8755-f0ee465300d1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:49.910729 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-136c0903-fcc0-449e-8755-f0ee465300d1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:49.911221 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-136c0903-fcc0-449e-8755-f0ee465300d1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:49.911652 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-136c0903-fcc0-449e-8755-f0ee465300d1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:50.047477 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-136c0903-fcc0-449e-8755-f0ee465300d1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:50.057084 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-136c0903-fcc0-449e-8755-f0ee465300d1 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1554 microversion: 2.1 time: 0.159973 Aug 24 08:57:50.057974 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 197/396] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:49 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:50.711795 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0060ece8-7c1f-454b-a120-0eaaed6eaf3a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:50.712498 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0060ece8-7c1f-454b-a120-0eaaed6eaf3a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:50.719472 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0060ece8-7c1f-454b-a120-0eaaed6eaf3a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:50.720278 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0060ece8-7c1f-454b-a120-0eaaed6eaf3a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:50.720880 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0060ece8-7c1f-454b-a120-0eaaed6eaf3a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:50.721774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0060ece8-7c1f-454b-a120-0eaaed6eaf3a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:50.722415 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0060ece8-7c1f-454b-a120-0eaaed6eaf3a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:50.722849 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0060ece8-7c1f-454b-a120-0eaaed6eaf3a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:50.743785 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ad255f87-b2fb-4734-a669-3a7dd3f19944 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:50.744451 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ad255f87-b2fb-4734-a669-3a7dd3f19944 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:50.757120 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad255f87-b2fb-4734-a669-3a7dd3f19944 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:50.757650 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad255f87-b2fb-4734-a669-3a7dd3f19944 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:50.758265 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad255f87-b2fb-4734-a669-3a7dd3f19944 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:50.759056 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad255f87-b2fb-4734-a669-3a7dd3f19944 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:50.759543 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad255f87-b2fb-4734-a669-3a7dd3f19944 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:50.760746 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ad255f87-b2fb-4734-a669-3a7dd3f19944 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:50.953574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ad255f87-b2fb-4734-a669-3a7dd3f19944 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:50.957027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0060ece8-7c1f-454b-a120-0eaaed6eaf3a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:50.966420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ad255f87-b2fb-4734-a669-3a7dd3f19944 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1314 microversion: 2.1 time: 0.227889 Aug 24 08:57:50.967021 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 198/397] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:50 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:50.967163 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0060ece8-7c1f-454b-a120-0eaaed6eaf3a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.259515 Aug 24 08:57:50.976947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 200/398] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:50 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:51.079342 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cb9cff17-00a0-4457-a9d9-869bed13da17 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:51.079993 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cb9cff17-00a0-4457-a9d9-869bed13da17 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:51.087282 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb9cff17-00a0-4457-a9d9-869bed13da17 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:51.087875 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb9cff17-00a0-4457-a9d9-869bed13da17 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:51.088496 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb9cff17-00a0-4457-a9d9-869bed13da17 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:51.089374 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb9cff17-00a0-4457-a9d9-869bed13da17 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:51.090023 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb9cff17-00a0-4457-a9d9-869bed13da17 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:51.090455 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb9cff17-00a0-4457-a9d9-869bed13da17 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:51.235856 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cb9cff17-00a0-4457-a9d9-869bed13da17 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:51.244993 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cb9cff17-00a0-4457-a9d9-869bed13da17 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1554 microversion: 2.1 time: 0.169551 Aug 24 08:57:51.245920 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 199/399] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:51 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:51.989526 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-768c6e28-21cf-4e05-8d37-6f641fd00bf2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:51.990151 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-768c6e28-21cf-4e05-8d37-6f641fd00bf2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:51.998047 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b8f52b5b-75be-484d-9731-ddcbcbb3c7a3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:51.998739 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768c6e28-21cf-4e05-8d37-6f641fd00bf2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:51.998739 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768c6e28-21cf-4e05-8d37-6f641fd00bf2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:51.999036 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b8f52b5b-75be-484d-9731-ddcbcbb3c7a3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:51.999171 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768c6e28-21cf-4e05-8d37-6f641fd00bf2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:51.999776 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768c6e28-21cf-4e05-8d37-6f641fd00bf2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:52.000368 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768c6e28-21cf-4e05-8d37-6f641fd00bf2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:52.000701 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-768c6e28-21cf-4e05-8d37-6f641fd00bf2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:52.005198 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8f52b5b-75be-484d-9731-ddcbcbb3c7a3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:52.005692 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8f52b5b-75be-484d-9731-ddcbcbb3c7a3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:52.006291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8f52b5b-75be-484d-9731-ddcbcbb3c7a3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:52.007533 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8f52b5b-75be-484d-9731-ddcbcbb3c7a3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:52.007994 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8f52b5b-75be-484d-9731-ddcbcbb3c7a3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:52.008454 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8f52b5b-75be-484d-9731-ddcbcbb3c7a3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:52.197863 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-768c6e28-21cf-4e05-8d37-6f641fd00bf2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:52.200698 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:52.208418 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-768c6e28-21cf-4e05-8d37-6f641fd00bf2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1314 microversion: 2.1 time: 0.222680 Aug 24 08:57:52.208995 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 201/400] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:51 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:52.210930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b8f52b5b-75be-484d-9731-ddcbcbb3c7a3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:52.220031 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b8f52b5b-75be-484d-9731-ddcbcbb3c7a3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.226109 Aug 24 08:57:52.220896 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 200/401] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:51 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:52.267923 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5673aedd-fbd8-4f8f-a054-dd4139e580e6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:52.270533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5673aedd-fbd8-4f8f-a054-dd4139e580e6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:52.275550 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5673aedd-fbd8-4f8f-a054-dd4139e580e6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:52.276052 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5673aedd-fbd8-4f8f-a054-dd4139e580e6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:52.276516 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5673aedd-fbd8-4f8f-a054-dd4139e580e6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:52.277328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5673aedd-fbd8-4f8f-a054-dd4139e580e6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:52.277794 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5673aedd-fbd8-4f8f-a054-dd4139e580e6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:52.278228 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5673aedd-fbd8-4f8f-a054-dd4139e580e6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:52.424458 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5673aedd-fbd8-4f8f-a054-dd4139e580e6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:52.435499 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5673aedd-fbd8-4f8f-a054-dd4139e580e6 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1554 microversion: 2.1 time: 0.171902 Aug 24 08:57:52.436081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 202/402] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:52 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:53.085057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-44c078d7-6d81-44a7-bad1-686e1386d087 req-7936a750-58a8-4923-9835-db01234645e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9fe4277-954f-428e-8652-af3bbf1f0977", "name": "network-vif-unplugged", "status": "completed", "tag": "11b3a920-2e8c-4bc1-beec-00dad8bb96b6"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:53.097402 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-44c078d7-6d81-44a7-bad1-686e1386d087 req-7936a750-58a8-4923-9835-db01234645e0 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:53.098005 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-44c078d7-6d81-44a7-bad1-686e1386d087 req-7936a750-58a8-4923-9835-db01234645e0 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:53.098549 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-44c078d7-6d81-44a7-bad1-686e1386d087 req-7936a750-58a8-4923-9835-db01234645e0 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:53.119375 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-44c078d7-6d81-44a7-bad1-686e1386d087 req-7936a750-58a8-4923-9835-db01234645e0 service nova] Creating event network-vif-unplugged:11b3a920-2e8c-4bc1-beec-00dad8bb96b6 for instance f9fe4277-954f-428e-8652-af3bbf1f0977 on hv-cinder-83538 Aug 24 08:57:53.129743 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-44c078d7-6d81-44a7-bad1-686e1386d087 req-7936a750-58a8-4923-9835-db01234645e0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049752 Aug 24 08:57:53.131315 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 201/403] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:53.230587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-10bf2f5c-b67f-4f93-b340-629689975b65 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:53.231337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-10bf2f5c-b67f-4f93-b340-629689975b65 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:53.238041 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10bf2f5c-b67f-4f93-b340-629689975b65 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:53.238614 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10bf2f5c-b67f-4f93-b340-629689975b65 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:53.239236 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10bf2f5c-b67f-4f93-b340-629689975b65 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:53.239953 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10bf2f5c-b67f-4f93-b340-629689975b65 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:53.240457 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10bf2f5c-b67f-4f93-b340-629689975b65 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:53.241074 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-10bf2f5c-b67f-4f93-b340-629689975b65 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:53.243125 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-af1d5e18-3399-4acb-a45c-63b0d82e2706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:53.244076 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-af1d5e18-3399-4acb-a45c-63b0d82e2706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:53.251877 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af1d5e18-3399-4acb-a45c-63b0d82e2706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:53.252506 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af1d5e18-3399-4acb-a45c-63b0d82e2706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:53.253011 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af1d5e18-3399-4acb-a45c-63b0d82e2706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:53.253820 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af1d5e18-3399-4acb-a45c-63b0d82e2706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:53.254349 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af1d5e18-3399-4acb-a45c-63b0d82e2706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:53.254844 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af1d5e18-3399-4acb-a45c-63b0d82e2706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:53.781055 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-10bf2f5c-b67f-4f93-b340-629689975b65 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:53.786193 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-af1d5e18-3399-4acb-a45c-63b0d82e2706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:53.793650 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-10bf2f5c-b67f-4f93-b340-629689975b65 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1314 microversion: 2.1 time: 0.566843 Aug 24 08:57:53.796050 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-af1d5e18-3399-4acb-a45c-63b0d82e2706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.557686 Aug 24 08:57:53.808717 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 203/404] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:53 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:53.810448 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 202/405] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:53 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:53.816633 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-607ee6d9-b67e-4418-95e7-51644f28a7a8 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:53.817053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-607ee6d9-b67e-4418-95e7-51644f28a7a8 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:53.823860 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-607ee6d9-b67e-4418-95e7-51644f28a7a8 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:53.824678 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-607ee6d9-b67e-4418-95e7-51644f28a7a8 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:53.825406 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-607ee6d9-b67e-4418-95e7-51644f28a7a8 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:53.826051 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-607ee6d9-b67e-4418-95e7-51644f28a7a8 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:53.826756 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-607ee6d9-b67e-4418-95e7-51644f28a7a8 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:53.827390 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-607ee6d9-b67e-4418-95e7-51644f28a7a8 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:54.171602 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-43b387cf-37f5-4054-8ac6-a259e509c678 req-45128e33-1d0f-41f8-91d2-0f4f5ec6939b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9fe4277-954f-428e-8652-af3bbf1f0977", "name": "network-vif-deleted", "tag": "11b3a920-2e8c-4bc1-beec-00dad8bb96b6"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:54.176908 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-607ee6d9-b67e-4418-95e7-51644f28a7a8 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c036cb4ba8e4a16bd9e884243e665c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39195166aed84c998b13b926c0a39ab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:54.187391 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-607ee6d9-b67e-4418-95e7-51644f28a7a8 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 200 len: 1554 microversion: 2.1 time: 0.378272 Aug 24 08:57:54.188328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 204/406] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:53 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 1554 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:54.202092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-43b387cf-37f5-4054-8ac6-a259e509c678 req-45128e33-1d0f-41f8-91d2-0f4f5ec6939b service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:54.203808 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-43b387cf-37f5-4054-8ac6-a259e509c678 req-45128e33-1d0f-41f8-91d2-0f4f5ec6939b service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:54.204801 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-43b387cf-37f5-4054-8ac6-a259e509c678 req-45128e33-1d0f-41f8-91d2-0f4f5ec6939b service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:54.220318 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-43b387cf-37f5-4054-8ac6-a259e509c678 req-45128e33-1d0f-41f8-91d2-0f4f5ec6939b service nova] Creating event network-vif-deleted:11b3a920-2e8c-4bc1-beec-00dad8bb96b6 for instance f9fe4277-954f-428e-8652-af3bbf1f0977 on hv-cinder-83538 Aug 24 08:57:54.227574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-43b387cf-37f5-4054-8ac6-a259e509c678 req-45128e33-1d0f-41f8-91d2-0f4f5ec6939b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065983 Aug 24 08:57:54.228846 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 203/407] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:54.814491 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-40846dc6-00e6-4672-b681-ebece91c26c3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:54.815848 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-40846dc6-00e6-4672-b681-ebece91c26c3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:54.824699 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40846dc6-00e6-4672-b681-ebece91c26c3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:54.825542 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40846dc6-00e6-4672-b681-ebece91c26c3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:54.825737 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3b394087-a0dd-4061-9a56-a9d95831a706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:54.826051 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40846dc6-00e6-4672-b681-ebece91c26c3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:54.826861 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3b394087-a0dd-4061-9a56-a9d95831a706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:54.826994 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40846dc6-00e6-4672-b681-ebece91c26c3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:54.827435 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40846dc6-00e6-4672-b681-ebece91c26c3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:54.828193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40846dc6-00e6-4672-b681-ebece91c26c3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:54.837254 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b394087-a0dd-4061-9a56-a9d95831a706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:54.837956 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b394087-a0dd-4061-9a56-a9d95831a706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:54.838739 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b394087-a0dd-4061-9a56-a9d95831a706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:54.840327 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b394087-a0dd-4061-9a56-a9d95831a706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:54.841538 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b394087-a0dd-4061-9a56-a9d95831a706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:54.842152 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b394087-a0dd-4061-9a56-a9d95831a706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:55.177045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3b394087-a0dd-4061-9a56-a9d95831a706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:55.193115 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3b394087-a0dd-4061-9a56-a9d95831a706 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.376360 Aug 24 08:57:55.194497 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 204/408] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:54 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:55.214576 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e553c62e-4797-4e3e-bc53-ce11925f7ac5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:55.215142 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e553c62e-4797-4e3e-bc53-ce11925f7ac5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:55.228482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e553c62e-4797-4e3e-bc53-ce11925f7ac5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:55.229940 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e553c62e-4797-4e3e-bc53-ce11925f7ac5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:55.230839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e553c62e-4797-4e3e-bc53-ce11925f7ac5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:55.231718 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e553c62e-4797-4e3e-bc53-ce11925f7ac5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:55.232740 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e553c62e-4797-4e3e-bc53-ce11925f7ac5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:55.233552 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e553c62e-4797-4e3e-bc53-ce11925f7ac5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:55.251794 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-40846dc6-00e6-4672-b681-ebece91c26c3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:55.267078 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-40846dc6-00e6-4672-b681-ebece91c26c3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1314 microversion: 2.1 time: 0.456367 Aug 24 08:57:55.268047 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 205/409] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:54 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:55.275121 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e553c62e-4797-4e3e-bc53-ce11925f7ac5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] HTTP exception thrown: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e553c62e-4797-4e3e-bc53-ce11925f7ac5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Request method failure captured: Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 HTTP/1.1 Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeeUdLtXFtyPbtWCNmkRBin1-QcNx9lnPoL52OmkcNNokyARBFezn2-g33tXvzSWYTLpYkiwLlORMPcuuBZE6Ps2yxxo8828cHEu7jvLRMU57eVf_MdHbfS-Syu6kjYnjV-V-JiwipYp3NtopUSx3F97qAuIk1mWXo50RZ9adIEf8Kk Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 39195166aed84c998b13b926c0a39ab7 Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-326988433 Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 08:57:55.280544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 08:57:55.282196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_39195166aed84c998b13b926c0a39ab7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/39195166aed84c998b13b926c0a39ab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/39195166aed84c998b13b926c0a39ab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/39195166aed84c998b13b926c0a39ab7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:57:55.282196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-326988433 Aug 24 08:57:55.282196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 39195166aed84c998b13b926c0a39ab7 Aug 24 08:57:55.282196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-326988433 Aug 24 08:57:55.282196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-326988433-project Aug 24 08:57:55.282196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 08:57:55.282196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 08:57:55.282196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: 5c036cb4ba8e4a16bd9e884243e665c1 Aug 24 08:57:55.282196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-326988433-project Aug 24 08:57:55.282196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 08:57:55.282196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:55.282196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': 'f9fe4277-954f-428e-8652-af3bbf1f0977'} Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:57:55.284358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:55.285864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:57:55.287156 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e553c62e-4797-4e3e-bc53-ce11925f7ac5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Returning 404 to user: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:57:55.287156 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e553c62e-4797-4e3e-bc53-ce11925f7ac5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 404 len: 111 microversion: 2.1 time: 0.075364 Aug 24 08:57:55.287156 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 205/410] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:55 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:57:55.419847 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-33a64896-4bfa-4414-bc68-4bdc989cb4f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:55.424068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-33a64896-4bfa-4414-bc68-4bdc989cb4f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:55.437354 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33a64896-4bfa-4414-bc68-4bdc989cb4f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:55.440261 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33a64896-4bfa-4414-bc68-4bdc989cb4f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:55.441074 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33a64896-4bfa-4414-bc68-4bdc989cb4f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:55.441937 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33a64896-4bfa-4414-bc68-4bdc989cb4f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:55.442461 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33a64896-4bfa-4414-bc68-4bdc989cb4f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:55.443035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33a64896-4bfa-4414-bc68-4bdc989cb4f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:55.482396 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-33a64896-4bfa-4414-bc68-4bdc989cb4f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] HTTP exception thrown: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-33a64896-4bfa-4414-bc68-4bdc989cb4f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Request method failure captured: Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977/os-volume_attachments HTTP/1.1 Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeUdLtXFtyPbtWCNmkRBin1-QcNx9lnPoL52OmkcNNokyARBFezn2-g33tXvzSWYTLpYkiwLlORMPcuuBZE6Ps2yxxo8828cHEu7jvLRMU57eVf_MdHbfS-Syu6kjYnjV-V-JiwipYp3NtopUSx3F97qAuIk1mWXo50RZ9adIEf8Kk Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 39195166aed84c998b13b926c0a39ab7 Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-DeleteServersTestJSON-326988433 Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 08:57:55.488932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 08:57:55.490428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_39195166aed84c998b13b926c0a39ab7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/39195166aed84c998b13b926c0a39ab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/39195166aed84c998b13b926c0a39ab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/39195166aed84c998b13b926c0a39ab7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:57:55.490428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-DeleteServersTestJSON-326988433 Aug 24 08:57:55.490428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 39195166aed84c998b13b926c0a39ab7 Aug 24 08:57:55.490428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-DeleteServersTestJSON-326988433 Aug 24 08:57:55.490428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-DeleteServersTestJSON-326988433-project Aug 24 08:57:55.490428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 08:57:55.490428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 08:57:55.490428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: 5c036cb4ba8e4a16bd9e884243e665c1 Aug 24 08:57:55.490428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-DeleteServersTestJSON-326988433-project Aug 24 08:57:55.490428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 08:57:55.490428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:55.490428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'server_id': 'f9fe4277-954f-428e-8652-af3bbf1f0977'} Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:57:55.491894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:55.496337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:57:55.497557 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-33a64896-4bfa-4414-bc68-4bdc989cb4f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Returning 404 to user: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:57:55.497557 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-33a64896-4bfa-4414-bc68-4bdc989cb4f0 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.081585 Aug 24 08:57:55.497557 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 206/411] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 08:57:55 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977/os-volume_attachments => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:57:56.215059 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d778c68b-cf0e-4abc-80a2-489fc6c5a5ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:56.215705 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d778c68b-cf0e-4abc-80a2-489fc6c5a5ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:56.222163 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d778c68b-cf0e-4abc-80a2-489fc6c5a5ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:56.222799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d778c68b-cf0e-4abc-80a2-489fc6c5a5ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:56.223249 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d778c68b-cf0e-4abc-80a2-489fc6c5a5ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:56.224226 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d778c68b-cf0e-4abc-80a2-489fc6c5a5ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:56.224704 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d778c68b-cf0e-4abc-80a2-489fc6c5a5ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:56.225298 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d778c68b-cf0e-4abc-80a2-489fc6c5a5ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:56.296660 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4bef0df6-6d91-43a1-a3cd-5ffa5e5be217 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:56.298424 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4bef0df6-6d91-43a1-a3cd-5ffa5e5be217 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:56.308417 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bef0df6-6d91-43a1-a3cd-5ffa5e5be217 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:56.308417 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bef0df6-6d91-43a1-a3cd-5ffa5e5be217 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:56.308417 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bef0df6-6d91-43a1-a3cd-5ffa5e5be217 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:56.309126 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bef0df6-6d91-43a1-a3cd-5ffa5e5be217 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:56.309701 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bef0df6-6d91-43a1-a3cd-5ffa5e5be217 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:56.310442 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4bef0df6-6d91-43a1-a3cd-5ffa5e5be217 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:56.408353 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d778c68b-cf0e-4abc-80a2-489fc6c5a5ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:56.421505 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d778c68b-cf0e-4abc-80a2-489fc6c5a5ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.210417 Aug 24 08:57:56.422255 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 206/412] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:56 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:56.492517 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-4bef0df6-6d91-43a1-a3cd-5ffa5e5be217 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:56.500609 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4bef0df6-6d91-43a1-a3cd-5ffa5e5be217 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1314 microversion: 2.1 time: 0.209944 Aug 24 08:57:56.501538 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 207/413] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:56 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:57:56.761587 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ee35c757-c11b-4e77-a4a0-aeb74146c5a5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:56.762100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ee35c757-c11b-4e77-a4a0-aeb74146c5a5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:56.777955 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee35c757-c11b-4e77-a4a0-aeb74146c5a5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:56.778454 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee35c757-c11b-4e77-a4a0-aeb74146c5a5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:56.778897 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee35c757-c11b-4e77-a4a0-aeb74146c5a5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:56.779634 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee35c757-c11b-4e77-a4a0-aeb74146c5a5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:56.780124 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee35c757-c11b-4e77-a4a0-aeb74146c5a5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:56.780584 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ee35c757-c11b-4e77-a4a0-aeb74146c5a5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:56.796956 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-ee35c757-c11b-4e77-a4a0-aeb74146c5a5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] HTTP exception thrown: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ee35c757-c11b-4e77-a4a0-aeb74146c5a5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Request method failure captured: Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 HTTP/1.1 Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeeUdLtXFtyPbtWCNmkRBin1-QcNx9lnPoL52OmkcNNokyARBFezn2-g33tXvzSWYTLpYkiwLlORMPcuuBZE6Ps2yxxo8828cHEu7jvLRMU57eVf_MdHbfS-Syu6kjYnjV-V-JiwipYp3NtopUSx3F97qAuIk1mWXo50RZ9adIEf8Kk Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 39195166aed84c998b13b926c0a39ab7 Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-DeleteServersTestJSON-326988433 Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 08:57:56.799690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 08:57:56.801082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_39195166aed84c998b13b926c0a39ab7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/39195166aed84c998b13b926c0a39ab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/39195166aed84c998b13b926c0a39ab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/39195166aed84c998b13b926c0a39ab7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:57:56.801082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-DeleteServersTestJSON-326988433 Aug 24 08:57:56.801082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 39195166aed84c998b13b926c0a39ab7 Aug 24 08:57:56.801082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-DeleteServersTestJSON-326988433 Aug 24 08:57:56.801082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-DeleteServersTestJSON-326988433-project Aug 24 08:57:56.801082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 08:57:56.801082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 08:57:56.801082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: 5c036cb4ba8e4a16bd9e884243e665c1 Aug 24 08:57:56.801082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-DeleteServersTestJSON-326988433-project Aug 24 08:57:56.801082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 08:57:56.801082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:56.801082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': 'f9fe4277-954f-428e-8652-af3bbf1f0977'} Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:57:56.801733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:56.802786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:57:56.804642 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ee35c757-c11b-4e77-a4a0-aeb74146c5a5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Returning 404 to user: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:57:56.804642 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ee35c757-c11b-4e77-a4a0-aeb74146c5a5 tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 404 len: 111 microversion: 2.1 time: 0.055763 Aug 24 08:57:56.804642 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 207/414] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 08:57:56 2022] DELETE /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:57:56.815406 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b3847735-8846-4abf-85ee-19930c43250c tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:56.816035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b3847735-8846-4abf-85ee-19930c43250c tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] [instance: f9fe4277-954f-428e-8652-af3bbf1f0977] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:56.823720 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3847735-8846-4abf-85ee-19930c43250c tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:56.824400 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3847735-8846-4abf-85ee-19930c43250c tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:56.825039 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3847735-8846-4abf-85ee-19930c43250c tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:56.825949 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3847735-8846-4abf-85ee-19930c43250c tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:56.826613 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3847735-8846-4abf-85ee-19930c43250c tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:56.827049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3847735-8846-4abf-85ee-19930c43250c tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:56.844848 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-b3847735-8846-4abf-85ee-19930c43250c tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] HTTP exception thrown: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b3847735-8846-4abf-85ee-19930c43250c tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Request method failure captured: Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 HTTP/1.1 Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeUdLtXFtyPbtWCNmkRBin1-QcNx9lnPoL52OmkcNNokyARBFezn2-g33tXvzSWYTLpYkiwLlORMPcuuBZE6Ps2yxxo8828cHEu7jvLRMU57eVf_MdHbfS-Syu6kjYnjV-V-JiwipYp3NtopUSx3F97qAuIk1mWXo50RZ9adIEf8Kk Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 39195166aed84c998b13b926c0a39ab7 Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-DeleteServersTestJSON-326988433 Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 08:57:56.847117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 08:57:56.848719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_39195166aed84c998b13b926c0a39ab7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/39195166aed84c998b13b926c0a39ab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/39195166aed84c998b13b926c0a39ab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/39195166aed84c998b13b926c0a39ab7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:57:56.848719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-DeleteServersTestJSON-326988433 Aug 24 08:57:56.848719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 39195166aed84c998b13b926c0a39ab7 Aug 24 08:57:56.848719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-DeleteServersTestJSON-326988433 Aug 24 08:57:56.848719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-DeleteServersTestJSON-326988433-project Aug 24 08:57:56.848719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 08:57:56.848719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 08:57:56.848719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: 5c036cb4ba8e4a16bd9e884243e665c1 Aug 24 08:57:56.848719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-DeleteServersTestJSON-326988433-project Aug 24 08:57:56.848719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 08:57:56.848719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:56.848719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': 'f9fe4277-954f-428e-8652-af3bbf1f0977'} Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:57:56.849873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. Aug 24 08:57:56.851274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:57:56.853666 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b3847735-8846-4abf-85ee-19930c43250c tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] Returning 404 to user: Instance f9fe4277-954f-428e-8652-af3bbf1f0977 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:57:56.853666 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b3847735-8846-4abf-85ee-19930c43250c tempest-DeleteServersTestJSON-326988433 tempest-DeleteServersTestJSON-326988433-project] 10.222.0.67 "GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977" status: 404 len: 111 microversion: 2.1 time: 0.040075 Aug 24 08:57:56.853666 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 208/415] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:56 2022] GET /compute/v2.1/servers/f9fe4277-954f-428e-8652-af3bbf1f0977 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:57:57.190044 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-edf81cec-66df-4183-a0ae-62138b285abb req-5cbe38b5-f360-4d20-9893-a2b0a65fe7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deef385e-6b4c-4800-b1c5-5620d0f0f56f", "name": "network-vif-plugged", "status": "completed", "tag": "05f06d68-8ebb-4a09-92d8-7e73fa276d34"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:57:57.201924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-edf81cec-66df-4183-a0ae-62138b285abb req-5cbe38b5-f360-4d20-9893-a2b0a65fe7bf service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:57.203031 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-edf81cec-66df-4183-a0ae-62138b285abb req-5cbe38b5-f360-4d20-9893-a2b0a65fe7bf service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:57.203671 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-edf81cec-66df-4183-a0ae-62138b285abb req-5cbe38b5-f360-4d20-9893-a2b0a65fe7bf service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:57.217178 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-edf81cec-66df-4183-a0ae-62138b285abb req-5cbe38b5-f360-4d20-9893-a2b0a65fe7bf service nova] Creating event network-vif-plugged:05f06d68-8ebb-4a09-92d8-7e73fa276d34 for instance deef385e-6b4c-4800-b1c5-5620d0f0f56f on hv-cinder-83538 Aug 24 08:57:57.225875 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-edf81cec-66df-4183-a0ae-62138b285abb req-5cbe38b5-f360-4d20-9893-a2b0a65fe7bf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038305 Aug 24 08:57:57.226828 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 208/416] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:57:57.443332 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-230ce31f-98fd-4350-9ff7-2027f718a44e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:57.444634 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-230ce31f-98fd-4350-9ff7-2027f718a44e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:57.461499 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-230ce31f-98fd-4350-9ff7-2027f718a44e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:57.462402 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-230ce31f-98fd-4350-9ff7-2027f718a44e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:57.463179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-230ce31f-98fd-4350-9ff7-2027f718a44e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:57.464345 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-230ce31f-98fd-4350-9ff7-2027f718a44e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:57.465214 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-230ce31f-98fd-4350-9ff7-2027f718a44e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:57.466002 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-230ce31f-98fd-4350-9ff7-2027f718a44e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:57.524126 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a0ebf783-94f4-4f5e-a009-6a53844dc921 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:57.524832 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a0ebf783-94f4-4f5e-a009-6a53844dc921 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:57.531434 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0ebf783-94f4-4f5e-a009-6a53844dc921 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:57.531922 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0ebf783-94f4-4f5e-a009-6a53844dc921 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:57.532386 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0ebf783-94f4-4f5e-a009-6a53844dc921 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:57.533092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0ebf783-94f4-4f5e-a009-6a53844dc921 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:57.533546 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0ebf783-94f4-4f5e-a009-6a53844dc921 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:57.533964 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a0ebf783-94f4-4f5e-a009-6a53844dc921 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:57.944485 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a0ebf783-94f4-4f5e-a009-6a53844dc921 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:57.953112 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a0ebf783-94f4-4f5e-a009-6a53844dc921 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1314 microversion: 2.1 time: 0.433766 Aug 24 08:57:57.953644 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 209/417] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:57 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:57.964151 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-230ce31f-98fd-4350-9ff7-2027f718a44e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:57.973754 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-230ce31f-98fd-4350-9ff7-2027f718a44e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.534595 Aug 24 08:57:57.974333 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 209/418] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:57 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:58.974656 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-38641910-b8aa-4c45-9b8f-31d8e644b735 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:58.975788 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-38641910-b8aa-4c45-9b8f-31d8e644b735 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:58.983462 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38641910-b8aa-4c45-9b8f-31d8e644b735 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:58.983968 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38641910-b8aa-4c45-9b8f-31d8e644b735 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:58.984605 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38641910-b8aa-4c45-9b8f-31d8e644b735 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:58.985155 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38641910-b8aa-4c45-9b8f-31d8e644b735 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:58.986241 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38641910-b8aa-4c45-9b8f-31d8e644b735 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:58.986773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-38641910-b8aa-4c45-9b8f-31d8e644b735 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:58.998439 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7e1b89c1-fd55-4ab6-a039-f1b104a7207b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:57:58.999061 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7e1b89c1-fd55-4ab6-a039-f1b104a7207b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:57:59.007368 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e1b89c1-fd55-4ab6-a039-f1b104a7207b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:59.008156 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e1b89c1-fd55-4ab6-a039-f1b104a7207b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:59.008900 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e1b89c1-fd55-4ab6-a039-f1b104a7207b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:59.009886 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e1b89c1-fd55-4ab6-a039-f1b104a7207b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:57:59.011122 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e1b89c1-fd55-4ab6-a039-f1b104a7207b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:57:59.011766 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7e1b89c1-fd55-4ab6-a039-f1b104a7207b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:57:59.319308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-38641910-b8aa-4c45-9b8f-31d8e644b735 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:59.329431 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-38641910-b8aa-4c45-9b8f-31d8e644b735 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1314 microversion: 2.1 time: 0.358755 Aug 24 08:57:59.330128 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 210/419] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:58 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:57:59.340364 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7e1b89c1-fd55-4ab6-a039-f1b104a7207b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:57:59.351474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7e1b89c1-fd55-4ab6-a039-f1b104a7207b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.356284 Aug 24 08:57:59.352502 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 210/420] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:57:58 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:00.351041 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-926d85c8-5532-4e10-84b0-dcbc5e606be6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:00.351636 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-926d85c8-5532-4e10-84b0-dcbc5e606be6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:00.357773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-926d85c8-5532-4e10-84b0-dcbc5e606be6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:00.358950 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-926d85c8-5532-4e10-84b0-dcbc5e606be6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:00.359910 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-926d85c8-5532-4e10-84b0-dcbc5e606be6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:00.361403 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-926d85c8-5532-4e10-84b0-dcbc5e606be6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:00.362327 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-926d85c8-5532-4e10-84b0-dcbc5e606be6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:00.362969 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-926d85c8-5532-4e10-84b0-dcbc5e606be6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:00.375340 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f4d4976a-6add-44f0-a7c4-1edbc80b8226 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:00.376738 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f4d4976a-6add-44f0-a7c4-1edbc80b8226 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:00.384462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d4976a-6add-44f0-a7c4-1edbc80b8226 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:00.388126 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d4976a-6add-44f0-a7c4-1edbc80b8226 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:00.389695 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d4976a-6add-44f0-a7c4-1edbc80b8226 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:00.392046 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d4976a-6add-44f0-a7c4-1edbc80b8226 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:00.394998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d4976a-6add-44f0-a7c4-1edbc80b8226 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:00.396540 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f4d4976a-6add-44f0-a7c4-1edbc80b8226 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:00.681169 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-926d85c8-5532-4e10-84b0-dcbc5e606be6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:00.701787 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-926d85c8-5532-4e10-84b0-dcbc5e606be6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1498 microversion: 2.1 time: 0.354084 Aug 24 08:58:00.716121 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 211/421] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:00 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1498 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:00.716619 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f4d4976a-6add-44f0-a7c4-1edbc80b8226 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:00.736343 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f4d4976a-6add-44f0-a7c4-1edbc80b8226 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.365765 Aug 24 08:58:00.736865 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 211/422] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:00 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:01.245448 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-88c1cbd4-3cf2-4fed-82a5-e4ee6419c323 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:01.245955 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-88c1cbd4-3cf2-4fed-82a5-e4ee6419c323 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:01.252720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88c1cbd4-3cf2-4fed-82a5-e4ee6419c323 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:01.253218 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88c1cbd4-3cf2-4fed-82a5-e4ee6419c323 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:01.253662 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88c1cbd4-3cf2-4fed-82a5-e4ee6419c323 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:01.254370 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88c1cbd4-3cf2-4fed-82a5-e4ee6419c323 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:01.254831 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88c1cbd4-3cf2-4fed-82a5-e4ee6419c323 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:01.255258 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88c1cbd4-3cf2-4fed-82a5-e4ee6419c323 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:01.300585 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-88c1cbd4-3cf2-4fed-82a5-e4ee6419c323 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:58:01.410166 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-88c1cbd4-3cf2-4fed-82a5-e4ee6419c323 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "DELETE /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 204 len: 0 microversion: 2.1 time: 0.169143 Aug 24 08:58:01.415373 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 212/423] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 08:58:01 2022] DELETE /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:58:01.426803 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32b9eefa-c2c1-47f4-814e-7b2cc82c033b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:01.427376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-32b9eefa-c2c1-47f4-814e-7b2cc82c033b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:01.435999 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b9eefa-c2c1-47f4-814e-7b2cc82c033b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:01.436541 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b9eefa-c2c1-47f4-814e-7b2cc82c033b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:01.436974 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b9eefa-c2c1-47f4-814e-7b2cc82c033b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:01.437666 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b9eefa-c2c1-47f4-814e-7b2cc82c033b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:01.438309 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b9eefa-c2c1-47f4-814e-7b2cc82c033b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:01.438765 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b9eefa-c2c1-47f4-814e-7b2cc82c033b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:01.588042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-32b9eefa-c2c1-47f4-814e-7b2cc82c033b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:01.596881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-32b9eefa-c2c1-47f4-814e-7b2cc82c033b tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1504 microversion: 2.1 time: 0.173903 Aug 24 08:58:01.597548 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 212/424] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:01 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:01.761474 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-06355dfc-9a75-4530-b012-c5e40b4f12ec tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:01.762257 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-06355dfc-9a75-4530-b012-c5e40b4f12ec tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:01.769282 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06355dfc-9a75-4530-b012-c5e40b4f12ec tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:01.769830 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06355dfc-9a75-4530-b012-c5e40b4f12ec tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:01.770585 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06355dfc-9a75-4530-b012-c5e40b4f12ec tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:01.771302 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06355dfc-9a75-4530-b012-c5e40b4f12ec tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:01.771986 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06355dfc-9a75-4530-b012-c5e40b4f12ec tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:01.772861 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-06355dfc-9a75-4530-b012-c5e40b4f12ec tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:01.794836 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:01.937719 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-06355dfc-9a75-4530-b012-c5e40b4f12ec tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:01.959504 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-06355dfc-9a75-4530-b012-c5e40b4f12ec tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.202891 Aug 24 08:58:01.961242 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 213/425] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:01 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:02.619805 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3e9bcb8d-13fd-432f-8477-7d3ac16dd774 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:02.620444 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3e9bcb8d-13fd-432f-8477-7d3ac16dd774 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:02.623119 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:02.628344 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e9bcb8d-13fd-432f-8477-7d3ac16dd774 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:02.628990 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e9bcb8d-13fd-432f-8477-7d3ac16dd774 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:02.629471 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e9bcb8d-13fd-432f-8477-7d3ac16dd774 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:02.630555 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e9bcb8d-13fd-432f-8477-7d3ac16dd774 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:02.631017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e9bcb8d-13fd-432f-8477-7d3ac16dd774 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:02.631461 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e9bcb8d-13fd-432f-8477-7d3ac16dd774 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:02.778990 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3e9bcb8d-13fd-432f-8477-7d3ac16dd774 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:02.801219 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3e9bcb8d-13fd-432f-8477-7d3ac16dd774 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1504 microversion: 2.1 time: 0.186427 Aug 24 08:58:02.801941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 213/426] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:02 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:02.989019 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c4488244-21d3-4e6e-b3f4-6487ce96eb12 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:02.990027 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c4488244-21d3-4e6e-b3f4-6487ce96eb12 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:02.998752 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4488244-21d3-4e6e-b3f4-6487ce96eb12 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:02.999814 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4488244-21d3-4e6e-b3f4-6487ce96eb12 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:03.000286 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4488244-21d3-4e6e-b3f4-6487ce96eb12 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:03.000985 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4488244-21d3-4e6e-b3f4-6487ce96eb12 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:03.001846 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4488244-21d3-4e6e-b3f4-6487ce96eb12 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:03.002274 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4488244-21d3-4e6e-b3f4-6487ce96eb12 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:03.173573 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c4488244-21d3-4e6e-b3f4-6487ce96eb12 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:03.185689 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c4488244-21d3-4e6e-b3f4-6487ce96eb12 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.201371 Aug 24 08:58:03.185689 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 214/427] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:02 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:03.799962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-9e67a0c6-b985-4e94-9145-2c4410a03aab req-b762adb7-089f-4788-aa49-b935a1c80e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deef385e-6b4c-4800-b1c5-5620d0f0f56f", "name": "network-vif-deleted", "tag": "05f06d68-8ebb-4a09-92d8-7e73fa276d34"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:03.810832 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9e67a0c6-b985-4e94-9145-2c4410a03aab req-b762adb7-089f-4788-aa49-b935a1c80e36 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:03.811321 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9e67a0c6-b985-4e94-9145-2c4410a03aab req-b762adb7-089f-4788-aa49-b935a1c80e36 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:03.811776 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9e67a0c6-b985-4e94-9145-2c4410a03aab req-b762adb7-089f-4788-aa49-b935a1c80e36 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:03.824362 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-573735c6-88bd-4c8c-9cba-25eebfa8e7c6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:03.826127 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-573735c6-88bd-4c8c-9cba-25eebfa8e7c6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:03.828847 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-9e67a0c6-b985-4e94-9145-2c4410a03aab req-b762adb7-089f-4788-aa49-b935a1c80e36 service nova] Creating event network-vif-deleted:05f06d68-8ebb-4a09-92d8-7e73fa276d34 for instance deef385e-6b4c-4800-b1c5-5620d0f0f56f on hv-cinder-83538 Aug 24 08:58:03.829726 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:03.836227 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-9e67a0c6-b985-4e94-9145-2c4410a03aab req-b762adb7-089f-4788-aa49-b935a1c80e36 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039794 Aug 24 08:58:03.837662 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 214/428] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:58:03.842114 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-573735c6-88bd-4c8c-9cba-25eebfa8e7c6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:03.842934 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-573735c6-88bd-4c8c-9cba-25eebfa8e7c6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:03.844375 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-573735c6-88bd-4c8c-9cba-25eebfa8e7c6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:03.845153 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-573735c6-88bd-4c8c-9cba-25eebfa8e7c6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:03.846427 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-573735c6-88bd-4c8c-9cba-25eebfa8e7c6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:03.847036 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-573735c6-88bd-4c8c-9cba-25eebfa8e7c6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:03.930778 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-573735c6-88bd-4c8c-9cba-25eebfa8e7c6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:03.939432 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-573735c6-88bd-4c8c-9cba-25eebfa8e7c6 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 200 len: 1299 microversion: 2.1 time: 0.119103 Aug 24 08:58:03.940025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 215/429] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:03 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:04.207575 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-302203ad-5ad2-4cae-bc89-0b9b45774454 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:04.208308 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-302203ad-5ad2-4cae-bc89-0b9b45774454 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:04.215469 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-302203ad-5ad2-4cae-bc89-0b9b45774454 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:04.216301 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-302203ad-5ad2-4cae-bc89-0b9b45774454 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:04.216512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-302203ad-5ad2-4cae-bc89-0b9b45774454 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:04.217218 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-302203ad-5ad2-4cae-bc89-0b9b45774454 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:04.217675 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-302203ad-5ad2-4cae-bc89-0b9b45774454 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:04.218186 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-302203ad-5ad2-4cae-bc89-0b9b45774454 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:04.389921 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-302203ad-5ad2-4cae-bc89-0b9b45774454 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:04.403323 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-302203ad-5ad2-4cae-bc89-0b9b45774454 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.199977 Aug 24 08:58:04.404492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 215/430] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:04 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:04.975146 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36fd0d0f-9aad-49c7-bb30-6d841b3ab980 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:04.976116 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-36fd0d0f-9aad-49c7-bb30-6d841b3ab980 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: deef385e-6b4c-4800-b1c5-5620d0f0f56f] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:04.985559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36fd0d0f-9aad-49c7-bb30-6d841b3ab980 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:04.986232 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36fd0d0f-9aad-49c7-bb30-6d841b3ab980 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:04.986640 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36fd0d0f-9aad-49c7-bb30-6d841b3ab980 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:04.987426 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36fd0d0f-9aad-49c7-bb30-6d841b3ab980 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:04.987889 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36fd0d0f-9aad-49c7-bb30-6d841b3ab980 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:04.988371 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-36fd0d0f-9aad-49c7-bb30-6d841b3ab980 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:05.004576 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-36fd0d0f-9aad-49c7-bb30-6d841b3ab980 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] HTTP exception thrown: Instance deef385e-6b4c-4800-b1c5-5620d0f0f56f could not be found. Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36fd0d0f-9aad-49c7-bb30-6d841b3ab980 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Request method failure captured: Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f HTTP/1.1 Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBef3Uq_le5phuv6dO0xK9G-lomNpF87npX75RXZi5-xcEEbdSfA8C59f746c_G9aFAYZlNPhaZzb52-Dz3Foqve2HBMCf545BZ4NK94DZBXQUlvTaxZxIchgIszeVCsChudMVmezAf_pIQfgq73tE-T4h41sSNxliPm2GGXS43r8ay8 Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 61de8fb05c3a45de90ff3238b61452bb Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-VolumesActionsTest-1839736605 Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 08:58:05.007482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 08:58:05.009158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_61de8fb05c3a45de90ff3238b61452bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/61de8fb05c3a45de90ff3238b61452bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/61de8fb05c3a45de90ff3238b61452bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/61de8fb05c3a45de90ff3238b61452bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:58:05.009158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-VolumesActionsTest-1839736605 Aug 24 08:58:05.009158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 61de8fb05c3a45de90ff3238b61452bb Aug 24 08:58:05.009158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-VolumesActionsTest-1839736605 Aug 24 08:58:05.009158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-VolumesActionsTest-1839736605-project Aug 24 08:58:05.009158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 08:58:05.009158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 08:58:05.009158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: 3095e7f94a58497c812890fa86e08eec Aug 24 08:58:05.009158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-VolumesActionsTest-1839736605-project Aug 24 08:58:05.009158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 08:58:05.009158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance deef385e-6b4c-4800-b1c5-5620d0f0f56f could not be found. Aug 24 08:58:05.009158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': 'deef385e-6b4c-4800-b1c5-5620d0f0f56f'} Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deef385e-6b4c-4800-b1c5-5620d0f0f56f could not be found. Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:58:05.009924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deef385e-6b4c-4800-b1c5-5620d0f0f56f could not be found. Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deef385e-6b4c-4800-b1c5-5620d0f0f56f could not be found. Aug 24 08:58:05.011109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:58:05.012276 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-36fd0d0f-9aad-49c7-bb30-6d841b3ab980 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Returning 404 to user: Instance deef385e-6b4c-4800-b1c5-5620d0f0f56f could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:58:05.012276 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-36fd0d0f-9aad-49c7-bb30-6d841b3ab980 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f" status: 404 len: 111 microversion: 2.1 time: 0.042423 Aug 24 08:58:05.013362 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 216/431] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:04 2022] GET /compute/v2.1/servers/deef385e-6b4c-4800-b1c5-5620d0f0f56f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:58:05.166756 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-675181508", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452", "networks": [{"uuid": "dc3b9ee1-fd38-4cdf-8521-276bf7f9bd26"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:05.243482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] validate_networks() for [('dc3b9ee1-fd38-4cdf-8521-276bf7f9bd26', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:58:05.428560 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-85246abb-cc9e-4d55-a4bb-7863b38e2d94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:05.429501 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-85246abb-cc9e-4d55-a4bb-7863b38e2d94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:05.446969 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85246abb-cc9e-4d55-a4bb-7863b38e2d94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:05.447562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85246abb-cc9e-4d55-a4bb-7863b38e2d94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:05.448400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85246abb-cc9e-4d55-a4bb-7863b38e2d94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:05.449446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85246abb-cc9e-4d55-a4bb-7863b38e2d94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:05.450113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85246abb-cc9e-4d55-a4bb-7863b38e2d94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:05.450807 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85246abb-cc9e-4d55-a4bb-7863b38e2d94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:05.747982 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-85246abb-cc9e-4d55-a4bb-7863b38e2d94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:05.756238 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-85246abb-cc9e-4d55-a4bb-7863b38e2d94 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.332435 Aug 24 08:58:05.757292 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 217/432] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:05 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:05.783682 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:58:05.784473 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:58:05.784953 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:58:05.785364 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:58:05.785801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:58:05.795453 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:05.796120 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:05.796575 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:05.797315 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:05.797767 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:05.798192 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:05.816147 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Getting quotas for project 61de8fb05c3a45de90ff3238b61452bb. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:58:05.820823 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Getting quotas for user 3095e7f94a58497c812890fa86e08eec and project 61de8fb05c3a45de90ff3238b61452bb. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:58:05.831968 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:58:05.834303 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:58:05.892271 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b380dfdc-6793-4472-bc60-9497700a7f31 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746899 Aug 24 08:58:05.893293 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 216/433] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 08:58:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:58:05.912348 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b54274a1-9e4b-434f-afdc-a6e39d5a03f2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:05.912962 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b54274a1-9e4b-434f-afdc-a6e39d5a03f2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:05.979631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b54274a1-9e4b-434f-afdc-a6e39d5a03f2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:05.987231 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b54274a1-9e4b-434f-afdc-a6e39d5a03f2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 200 len: 1213 microversion: 2.1 time: 0.083271 Aug 24 08:58:05.992142 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 218/434] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:05 2022] GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:06.778612 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5c4c56d1-495c-4df4-bd85-e280003e415f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:06.779260 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5c4c56d1-495c-4df4-bd85-e280003e415f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:06.786937 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c4c56d1-495c-4df4-bd85-e280003e415f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:06.787428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c4c56d1-495c-4df4-bd85-e280003e415f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:06.787866 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c4c56d1-495c-4df4-bd85-e280003e415f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:06.788804 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c4c56d1-495c-4df4-bd85-e280003e415f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:06.789305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c4c56d1-495c-4df4-bd85-e280003e415f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:06.789943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5c4c56d1-495c-4df4-bd85-e280003e415f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:06.956059 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5c4c56d1-495c-4df4-bd85-e280003e415f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:06.967243 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5c4c56d1-495c-4df4-bd85-e280003e415f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.193295 Aug 24 08:58:06.968196 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 217/435] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:06 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:07.015468 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7322643c-21e2-4eac-b085-5253bf15e817 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:07.016870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7322643c-21e2-4eac-b085-5253bf15e817 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:07.042312 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7322643c-21e2-4eac-b085-5253bf15e817 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:07.043957 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7322643c-21e2-4eac-b085-5253bf15e817 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:07.045068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7322643c-21e2-4eac-b085-5253bf15e817 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:07.054599 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7322643c-21e2-4eac-b085-5253bf15e817 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:07.056010 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7322643c-21e2-4eac-b085-5253bf15e817 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:07.056010 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7322643c-21e2-4eac-b085-5253bf15e817 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:07.177661 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7322643c-21e2-4eac-b085-5253bf15e817 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:07.188885 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7322643c-21e2-4eac-b085-5253bf15e817 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 200 len: 1273 microversion: 2.1 time: 0.183752 Aug 24 08:58:07.189528 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 219/436] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:07 2022] GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:07.992064 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-057d6691-82f5-4549-853c-9d52f2314359 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:07.993413 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-057d6691-82f5-4549-853c-9d52f2314359 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:08.006916 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-057d6691-82f5-4549-853c-9d52f2314359 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:08.007600 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-057d6691-82f5-4549-853c-9d52f2314359 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:08.008265 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-057d6691-82f5-4549-853c-9d52f2314359 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:08.010141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-057d6691-82f5-4549-853c-9d52f2314359 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:08.010894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-057d6691-82f5-4549-853c-9d52f2314359 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:08.011589 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-057d6691-82f5-4549-853c-9d52f2314359 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:08.210934 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-387d021a-8cc6-458c-9b78-54b111f4bdde tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:08.211953 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-387d021a-8cc6-458c-9b78-54b111f4bdde tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:08.223264 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-387d021a-8cc6-458c-9b78-54b111f4bdde tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:08.223754 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-387d021a-8cc6-458c-9b78-54b111f4bdde tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:08.224409 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-387d021a-8cc6-458c-9b78-54b111f4bdde tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:08.225118 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-387d021a-8cc6-458c-9b78-54b111f4bdde tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:08.225607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-387d021a-8cc6-458c-9b78-54b111f4bdde tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:08.226028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-387d021a-8cc6-458c-9b78-54b111f4bdde tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:08.262526 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-057d6691-82f5-4549-853c-9d52f2314359 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:08.270500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-057d6691-82f5-4549-853c-9d52f2314359 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.283199 Aug 24 08:58:08.271256 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 218/437] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:07 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:08.445835 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-387d021a-8cc6-458c-9b78-54b111f4bdde tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:08.455884 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-387d021a-8cc6-458c-9b78-54b111f4bdde tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 200 len: 1313 microversion: 2.1 time: 0.248725 Aug 24 08:58:08.456499 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 220/438] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:08 2022] GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:08.658429 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f668a9b6-0ab0-48f2-a223-668b0372634b req-f486b2f3-7319-45bd-93eb-fd9e423b52ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51596c50-f87f-4eeb-bb50-c743b2a826f1", "tag": "57cc5137-bfce-4d25-b98f-9746ad78a0a0"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:08.670188 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f668a9b6-0ab0-48f2-a223-668b0372634b req-f486b2f3-7319-45bd-93eb-fd9e423b52ed service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:08.670623 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f668a9b6-0ab0-48f2-a223-668b0372634b req-f486b2f3-7319-45bd-93eb-fd9e423b52ed service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:08.671046 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f668a9b6-0ab0-48f2-a223-668b0372634b req-f486b2f3-7319-45bd-93eb-fd9e423b52ed service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:08.690328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f668a9b6-0ab0-48f2-a223-668b0372634b req-f486b2f3-7319-45bd-93eb-fd9e423b52ed service nova] Creating event network-changed:57cc5137-bfce-4d25-b98f-9746ad78a0a0 for instance 51596c50-f87f-4eeb-bb50-c743b2a826f1 on hv-cinder-83538 Aug 24 08:58:08.697495 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f668a9b6-0ab0-48f2-a223-668b0372634b req-f486b2f3-7319-45bd-93eb-fd9e423b52ed service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044051 Aug 24 08:58:08.698418 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 219/439] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:58:09.294980 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bfc0aee1-7757-49bf-a6d7-d1879ef7cc02 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:09.295566 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bfc0aee1-7757-49bf-a6d7-d1879ef7cc02 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:09.301698 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfc0aee1-7757-49bf-a6d7-d1879ef7cc02 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:09.302189 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfc0aee1-7757-49bf-a6d7-d1879ef7cc02 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:09.302629 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfc0aee1-7757-49bf-a6d7-d1879ef7cc02 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:09.303367 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfc0aee1-7757-49bf-a6d7-d1879ef7cc02 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:09.303994 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfc0aee1-7757-49bf-a6d7-d1879ef7cc02 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:09.304532 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfc0aee1-7757-49bf-a6d7-d1879ef7cc02 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:09.451856 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-bfc0aee1-7757-49bf-a6d7-d1879ef7cc02 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:09.459932 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bfc0aee1-7757-49bf-a6d7-d1879ef7cc02 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.168882 Aug 24 08:58:09.460670 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 221/440] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:09 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:09.484461 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1fc73a0c-e60b-4b54-97a5-c05ebf5544d4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:09.485153 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1fc73a0c-e60b-4b54-97a5-c05ebf5544d4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:09.492116 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fc73a0c-e60b-4b54-97a5-c05ebf5544d4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:09.492648 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fc73a0c-e60b-4b54-97a5-c05ebf5544d4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:09.493192 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fc73a0c-e60b-4b54-97a5-c05ebf5544d4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:09.493903 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fc73a0c-e60b-4b54-97a5-c05ebf5544d4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:09.494354 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fc73a0c-e60b-4b54-97a5-c05ebf5544d4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:09.494778 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1fc73a0c-e60b-4b54-97a5-c05ebf5544d4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:09.632716 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1fc73a0c-e60b-4b54-97a5-c05ebf5544d4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:09.640994 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1fc73a0c-e60b-4b54-97a5-c05ebf5544d4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 200 len: 1313 microversion: 2.1 time: 0.161130 Aug 24 08:58:09.641581 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 220/441] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:09 2022] GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:10.482352 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-846a8018-6ac5-42f4-8f99-985c55c1620b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:10.483038 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-846a8018-6ac5-42f4-8f99-985c55c1620b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:10.490725 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-846a8018-6ac5-42f4-8f99-985c55c1620b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:10.491215 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-846a8018-6ac5-42f4-8f99-985c55c1620b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:10.491959 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-846a8018-6ac5-42f4-8f99-985c55c1620b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:10.492797 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-846a8018-6ac5-42f4-8f99-985c55c1620b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:10.493258 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-846a8018-6ac5-42f4-8f99-985c55c1620b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:10.493770 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-846a8018-6ac5-42f4-8f99-985c55c1620b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:10.668359 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-846a8018-6ac5-42f4-8f99-985c55c1620b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:10.668629 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dab56dba-734a-412c-adde-e37d645be7e2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:10.668629 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dab56dba-734a-412c-adde-e37d645be7e2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:10.673036 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-846a8018-6ac5-42f4-8f99-985c55c1620b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.195452 Aug 24 08:58:10.673610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dab56dba-734a-412c-adde-e37d645be7e2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:10.673805 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 222/442] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:10 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:10.674139 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dab56dba-734a-412c-adde-e37d645be7e2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:10.674653 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dab56dba-734a-412c-adde-e37d645be7e2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:10.675407 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dab56dba-734a-412c-adde-e37d645be7e2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:10.675872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dab56dba-734a-412c-adde-e37d645be7e2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:10.676333 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dab56dba-734a-412c-adde-e37d645be7e2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:10.810952 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-dab56dba-734a-412c-adde-e37d645be7e2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:10.813354 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:10.820635 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dab56dba-734a-412c-adde-e37d645be7e2 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 200 len: 1313 microversion: 2.1 time: 0.160805 Aug 24 08:58:10.821204 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 221/443] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:10 2022] GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:11.695395 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a344f218-10fb-4d2f-a6b3-b7cdfcdc41a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:11.696126 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a344f218-10fb-4d2f-a6b3-b7cdfcdc41a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:11.702449 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a344f218-10fb-4d2f-a6b3-b7cdfcdc41a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:11.702860 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a344f218-10fb-4d2f-a6b3-b7cdfcdc41a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:11.703303 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a344f218-10fb-4d2f-a6b3-b7cdfcdc41a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:11.704012 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a344f218-10fb-4d2f-a6b3-b7cdfcdc41a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:11.704511 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a344f218-10fb-4d2f-a6b3-b7cdfcdc41a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:11.705028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a344f218-10fb-4d2f-a6b3-b7cdfcdc41a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:11.841004 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8298d978-28ce-43eb-b1b7-4e9b84aab2b4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:11.841632 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8298d978-28ce-43eb-b1b7-4e9b84aab2b4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:11.848446 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8298d978-28ce-43eb-b1b7-4e9b84aab2b4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:11.849130 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8298d978-28ce-43eb-b1b7-4e9b84aab2b4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:11.849466 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a344f218-10fb-4d2f-a6b3-b7cdfcdc41a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:11.849586 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8298d978-28ce-43eb-b1b7-4e9b84aab2b4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:11.850254 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8298d978-28ce-43eb-b1b7-4e9b84aab2b4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:11.850710 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8298d978-28ce-43eb-b1b7-4e9b84aab2b4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:11.851214 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8298d978-28ce-43eb-b1b7-4e9b84aab2b4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:11.858846 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a344f218-10fb-4d2f-a6b3-b7cdfcdc41a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.168230 Aug 24 08:58:11.859637 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 223/444] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:11 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:12.000831 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8298d978-28ce-43eb-b1b7-4e9b84aab2b4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:12.009429 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8298d978-28ce-43eb-b1b7-4e9b84aab2b4 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 200 len: 1313 microversion: 2.1 time: 0.172150 Aug 24 08:58:12.010003 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 222/445] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:11 2022] GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:12.881134 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f108e4a7-2125-4c93-9226-1c035adb505a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:12.881903 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f108e4a7-2125-4c93-9226-1c035adb505a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:12.888982 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f108e4a7-2125-4c93-9226-1c035adb505a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:12.889467 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f108e4a7-2125-4c93-9226-1c035adb505a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:12.889941 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f108e4a7-2125-4c93-9226-1c035adb505a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:12.890920 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f108e4a7-2125-4c93-9226-1c035adb505a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:12.891668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f108e4a7-2125-4c93-9226-1c035adb505a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:12.892229 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f108e4a7-2125-4c93-9226-1c035adb505a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:13.028547 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f108e4a7-2125-4c93-9226-1c035adb505a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:13.030112 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fc2d8a2b-93d9-45d4-9a6f-aa96c0fcbb7c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:13.030736 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fc2d8a2b-93d9-45d4-9a6f-aa96c0fcbb7c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:13.036574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f108e4a7-2125-4c93-9226-1c035adb505a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.159352 Aug 24 08:58:13.037323 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc2d8a2b-93d9-45d4-9a6f-aa96c0fcbb7c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:13.037456 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 224/446] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:12 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:13.038099 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc2d8a2b-93d9-45d4-9a6f-aa96c0fcbb7c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:13.039033 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc2d8a2b-93d9-45d4-9a6f-aa96c0fcbb7c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:13.039753 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc2d8a2b-93d9-45d4-9a6f-aa96c0fcbb7c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:13.040417 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc2d8a2b-93d9-45d4-9a6f-aa96c0fcbb7c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:13.040981 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc2d8a2b-93d9-45d4-9a6f-aa96c0fcbb7c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:13.183085 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-fc2d8a2b-93d9-45d4-9a6f-aa96c0fcbb7c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:13.190944 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fc2d8a2b-93d9-45d4-9a6f-aa96c0fcbb7c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 200 len: 1313 microversion: 2.1 time: 0.164608 Aug 24 08:58:13.191534 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 223/447] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:13 2022] GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:14.059755 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2d13a065-50b9-42c9-b86d-7eeb7a0d4a6b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:14.060327 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2d13a065-50b9-42c9-b86d-7eeb7a0d4a6b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:14.066355 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d13a065-50b9-42c9-b86d-7eeb7a0d4a6b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:14.066847 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d13a065-50b9-42c9-b86d-7eeb7a0d4a6b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:14.067289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d13a065-50b9-42c9-b86d-7eeb7a0d4a6b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:14.068005 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d13a065-50b9-42c9-b86d-7eeb7a0d4a6b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:14.068501 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d13a065-50b9-42c9-b86d-7eeb7a0d4a6b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:14.068929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d13a065-50b9-42c9-b86d-7eeb7a0d4a6b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:14.213297 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6e6b4c19-11ed-414e-abc7-5ae40e4e8908 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:14.213881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6e6b4c19-11ed-414e-abc7-5ae40e4e8908 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:14.222794 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e6b4c19-11ed-414e-abc7-5ae40e4e8908 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:14.223619 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e6b4c19-11ed-414e-abc7-5ae40e4e8908 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:14.224645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e6b4c19-11ed-414e-abc7-5ae40e4e8908 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:14.225782 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e6b4c19-11ed-414e-abc7-5ae40e4e8908 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:14.226526 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e6b4c19-11ed-414e-abc7-5ae40e4e8908 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:14.226970 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e6b4c19-11ed-414e-abc7-5ae40e4e8908 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:14.496808 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2d13a065-50b9-42c9-b86d-7eeb7a0d4a6b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:14.500335 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-6e6b4c19-11ed-414e-abc7-5ae40e4e8908 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:14.505149 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2d13a065-50b9-42c9-b86d-7eeb7a0d4a6b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.449349 Aug 24 08:58:14.506019 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 225/448] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:14 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:14.510075 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6e6b4c19-11ed-414e-abc7-5ae40e4e8908 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 200 len: 1313 microversion: 2.1 time: 0.300999 Aug 24 08:58:14.510637 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 224/449] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:14 2022] GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:15.214178 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c0c87046-8d62-430f-906a-f9528c3f51ca req-5cd0fe11-3e4f-45b8-a8e3-85aa0fe504e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51596c50-f87f-4eeb-bb50-c743b2a826f1", "name": "network-vif-plugged", "status": "completed", "tag": "57cc5137-bfce-4d25-b98f-9746ad78a0a0"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:15.225834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c0c87046-8d62-430f-906a-f9528c3f51ca req-5cd0fe11-3e4f-45b8-a8e3-85aa0fe504e8 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:15.226608 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c0c87046-8d62-430f-906a-f9528c3f51ca req-5cd0fe11-3e4f-45b8-a8e3-85aa0fe504e8 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:15.227337 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c0c87046-8d62-430f-906a-f9528c3f51ca req-5cd0fe11-3e4f-45b8-a8e3-85aa0fe504e8 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:15.241154 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c0c87046-8d62-430f-906a-f9528c3f51ca req-5cd0fe11-3e4f-45b8-a8e3-85aa0fe504e8 service nova] Creating event network-vif-plugged:57cc5137-bfce-4d25-b98f-9746ad78a0a0 for instance 51596c50-f87f-4eeb-bb50-c743b2a826f1 on hv-cinder-83538 Aug 24 08:58:15.246809 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c0c87046-8d62-430f-906a-f9528c3f51ca req-5cd0fe11-3e4f-45b8-a8e3-85aa0fe504e8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037533 Aug 24 08:58:15.247645 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 226/450] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:58:15.528193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-89fc1579-99dc-4b01-8103-f0f70f4dff7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:15.528833 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-89fc1579-99dc-4b01-8103-f0f70f4dff7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:15.534776 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3e50e465-666e-41a3-9db1-9cffe5aea7ed tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:15.535938 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3e50e465-666e-41a3-9db1-9cffe5aea7ed tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:15.538033 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89fc1579-99dc-4b01-8103-f0f70f4dff7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:15.539447 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89fc1579-99dc-4b01-8103-f0f70f4dff7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:15.540646 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89fc1579-99dc-4b01-8103-f0f70f4dff7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:15.542157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89fc1579-99dc-4b01-8103-f0f70f4dff7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:15.542842 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89fc1579-99dc-4b01-8103-f0f70f4dff7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:15.543171 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e50e465-666e-41a3-9db1-9cffe5aea7ed tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:15.543296 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89fc1579-99dc-4b01-8103-f0f70f4dff7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:15.543663 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e50e465-666e-41a3-9db1-9cffe5aea7ed tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:15.544125 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e50e465-666e-41a3-9db1-9cffe5aea7ed tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:15.544817 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e50e465-666e-41a3-9db1-9cffe5aea7ed tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:15.545272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e50e465-666e-41a3-9db1-9cffe5aea7ed tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:15.545714 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e50e465-666e-41a3-9db1-9cffe5aea7ed tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:15.807415 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:15.828385 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:15.898652 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-89fc1579-99dc-4b01-8103-f0f70f4dff7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:15.902226 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3e50e465-666e-41a3-9db1-9cffe5aea7ed tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:15.906769 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-89fc1579-99dc-4b01-8103-f0f70f4dff7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.382761 Aug 24 08:58:15.907436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 225/451] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:15 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:15.910146 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3e50e465-666e-41a3-9db1-9cffe5aea7ed tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 200 len: 1313 microversion: 2.1 time: 0.379723 Aug 24 08:58:15.910712 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 227/452] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:15 2022] GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:16.927102 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-744e0036-dfe4-483e-ba87-6ed80a48d5e9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:16.927721 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-744e0036-dfe4-483e-ba87-6ed80a48d5e9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:16.930629 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1117ab3a-8e01-41f5-8f03-c4f54d55cf3f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:16.931251 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1117ab3a-8e01-41f5-8f03-c4f54d55cf3f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:16.933285 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:16.935321 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-744e0036-dfe4-483e-ba87-6ed80a48d5e9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:16.935931 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-744e0036-dfe4-483e-ba87-6ed80a48d5e9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:16.936409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-744e0036-dfe4-483e-ba87-6ed80a48d5e9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:16.937121 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-744e0036-dfe4-483e-ba87-6ed80a48d5e9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:16.937583 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-744e0036-dfe4-483e-ba87-6ed80a48d5e9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:16.938014 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-744e0036-dfe4-483e-ba87-6ed80a48d5e9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:16.938568 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1117ab3a-8e01-41f5-8f03-c4f54d55cf3f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:16.939066 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1117ab3a-8e01-41f5-8f03-c4f54d55cf3f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:16.939504 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1117ab3a-8e01-41f5-8f03-c4f54d55cf3f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:16.940232 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1117ab3a-8e01-41f5-8f03-c4f54d55cf3f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:16.940887 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1117ab3a-8e01-41f5-8f03-c4f54d55cf3f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:16.941324 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1117ab3a-8e01-41f5-8f03-c4f54d55cf3f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:17.137538 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-744e0036-dfe4-483e-ba87-6ed80a48d5e9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:17.144650 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1117ab3a-8e01-41f5-8f03-c4f54d55cf3f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:17.146656 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-744e0036-dfe4-483e-ba87-6ed80a48d5e9 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1519 microversion: 2.1 time: 0.223403 Aug 24 08:58:17.147311 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 226/453] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:16 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1519 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:17.152523 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1117ab3a-8e01-41f5-8f03-c4f54d55cf3f tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 200 len: 1313 microversion: 2.1 time: 0.225737 Aug 24 08:58:17.153087 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 228/454] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:16 2022] GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:18.171194 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-46d307bd-85d3-4b75-9cd6-60658ca3059c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:18.172026 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-46d307bd-85d3-4b75-9cd6-60658ca3059c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:18.173960 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7a4bbf02-952a-4be9-aa06-4c1c72e566f3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:18.174602 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7a4bbf02-952a-4be9-aa06-4c1c72e566f3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:18.178783 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46d307bd-85d3-4b75-9cd6-60658ca3059c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:18.179373 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46d307bd-85d3-4b75-9cd6-60658ca3059c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:18.180415 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46d307bd-85d3-4b75-9cd6-60658ca3059c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:18.181223 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46d307bd-85d3-4b75-9cd6-60658ca3059c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:18.181438 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a4bbf02-952a-4be9-aa06-4c1c72e566f3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:18.181719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46d307bd-85d3-4b75-9cd6-60658ca3059c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:18.181929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a4bbf02-952a-4be9-aa06-4c1c72e566f3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:18.182146 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46d307bd-85d3-4b75-9cd6-60658ca3059c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:18.182369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a4bbf02-952a-4be9-aa06-4c1c72e566f3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:18.183075 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a4bbf02-952a-4be9-aa06-4c1c72e566f3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:18.183527 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a4bbf02-952a-4be9-aa06-4c1c72e566f3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:18.183961 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a4bbf02-952a-4be9-aa06-4c1c72e566f3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:18.375547 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-46d307bd-85d3-4b75-9cd6-60658ca3059c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:18.379573 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7a4bbf02-952a-4be9-aa06-4c1c72e566f3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:18.383688 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-46d307bd-85d3-4b75-9cd6-60658ca3059c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1499 microversion: 2.1 time: 0.218080 Aug 24 08:58:18.384318 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 227/455] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:18 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1499 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:18.387992 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7a4bbf02-952a-4be9-aa06-4c1c72e566f3 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 200 len: 1313 microversion: 2.1 time: 0.218502 Aug 24 08:58:18.388601 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 229/456] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:18 2022] GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:18.403185 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-88d5341e-1311-436d-98d9-5e304d3deb22 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:18.403788 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-88d5341e-1311-436d-98d9-5e304d3deb22 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:18.409777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88d5341e-1311-436d-98d9-5e304d3deb22 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:18.410260 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88d5341e-1311-436d-98d9-5e304d3deb22 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:18.410695 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88d5341e-1311-436d-98d9-5e304d3deb22 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:18.411383 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88d5341e-1311-436d-98d9-5e304d3deb22 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:18.411860 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88d5341e-1311-436d-98d9-5e304d3deb22 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:18.412321 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88d5341e-1311-436d-98d9-5e304d3deb22 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:18.556514 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-88d5341e-1311-436d-98d9-5e304d3deb22 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:18.564976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-88d5341e-1311-436d-98d9-5e304d3deb22 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1515 microversion: 2.1 time: 0.165363 Aug 24 08:58:18.565634 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 228/457] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:18 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:19.409459 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-09bf3f10-466c-4dd9-afaa-3ff774fc6a58 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:19.410454 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-09bf3f10-466c-4dd9-afaa-3ff774fc6a58 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:19.416360 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09bf3f10-466c-4dd9-afaa-3ff774fc6a58 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:19.416847 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09bf3f10-466c-4dd9-afaa-3ff774fc6a58 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:19.417550 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09bf3f10-466c-4dd9-afaa-3ff774fc6a58 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:19.418267 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09bf3f10-466c-4dd9-afaa-3ff774fc6a58 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:19.418732 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09bf3f10-466c-4dd9-afaa-3ff774fc6a58 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:19.419161 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09bf3f10-466c-4dd9-afaa-3ff774fc6a58 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:19.568688 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-09bf3f10-466c-4dd9-afaa-3ff774fc6a58 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:19.577722 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-09bf3f10-466c-4dd9-afaa-3ff774fc6a58 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 200 len: 1496 microversion: 2.1 time: 0.172050 Aug 24 08:58:19.578312 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 230/458] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:19 2022] GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 1496 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:20.486425 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fd487630-59e1-4d4a-89e2-9972d657270e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:20.486970 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fd487630-59e1-4d4a-89e2-9972d657270e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:20.493561 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd487630-59e1-4d4a-89e2-9972d657270e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:20.494070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd487630-59e1-4d4a-89e2-9972d657270e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:20.494516 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd487630-59e1-4d4a-89e2-9972d657270e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:20.495232 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd487630-59e1-4d4a-89e2-9972d657270e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:20.495690 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd487630-59e1-4d4a-89e2-9972d657270e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:20.496144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd487630-59e1-4d4a-89e2-9972d657270e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:20.523092 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fd487630-59e1-4d4a-89e2-9972d657270e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 08:58:20.606051 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fd487630-59e1-4d4a-89e2-9972d657270e tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "DELETE /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 204 len: 0 microversion: 2.1 time: 0.123055 Aug 24 08:58:20.606649 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 229/459] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 08:58:20 2022] DELETE /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:58:20.614810 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-54669c6e-b2db-46f1-8850-0d92fb27ec8c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:20.615420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-54669c6e-b2db-46f1-8850-0d92fb27ec8c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:20.622612 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54669c6e-b2db-46f1-8850-0d92fb27ec8c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:20.623402 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54669c6e-b2db-46f1-8850-0d92fb27ec8c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:20.623904 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54669c6e-b2db-46f1-8850-0d92fb27ec8c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:20.624688 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54669c6e-b2db-46f1-8850-0d92fb27ec8c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:20.625217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54669c6e-b2db-46f1-8850-0d92fb27ec8c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:20.625646 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54669c6e-b2db-46f1-8850-0d92fb27ec8c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:20.786701 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-54669c6e-b2db-46f1-8850-0d92fb27ec8c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:20.794931 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-54669c6e-b2db-46f1-8850-0d92fb27ec8c tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 200 len: 1502 microversion: 2.1 time: 0.183863 Aug 24 08:58:20.795509 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 231/460] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:20 2022] GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:21.065530 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-356dc040-6c13-4dd6-a792-08b03f432e50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:21.068161 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-356dc040-6c13-4dd6-a792-08b03f432e50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:21.075326 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-356dc040-6c13-4dd6-a792-08b03f432e50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:21.075823 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-356dc040-6c13-4dd6-a792-08b03f432e50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:21.076290 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-356dc040-6c13-4dd6-a792-08b03f432e50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:21.077000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-356dc040-6c13-4dd6-a792-08b03f432e50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:21.077458 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-356dc040-6c13-4dd6-a792-08b03f432e50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:21.077890 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-356dc040-6c13-4dd6-a792-08b03f432e50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:21.104783 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-356dc040-6c13-4dd6-a792-08b03f432e50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lazy-loading 'flavor' on Instance uuid d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:58:21.230116 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-356dc040-6c13-4dd6-a792-08b03f432e50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "POST /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8/action" status: 200 len: 32 microversion: 2.1 time: 0.169941 Aug 24 08:58:21.231130 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 230/461] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 24 08:58:21 2022] POST /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 08:58:21.245442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-45a4d588-e3d1-4a08-af2f-67ad5e0e4816 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:21.246494 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-45a4d588-e3d1-4a08-af2f-67ad5e0e4816 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:21.253640 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45a4d588-e3d1-4a08-af2f-67ad5e0e4816 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:21.254221 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45a4d588-e3d1-4a08-af2f-67ad5e0e4816 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:21.254662 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45a4d588-e3d1-4a08-af2f-67ad5e0e4816 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:21.255365 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45a4d588-e3d1-4a08-af2f-67ad5e0e4816 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:21.255818 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45a4d588-e3d1-4a08-af2f-67ad5e0e4816 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:21.256278 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-45a4d588-e3d1-4a08-af2f-67ad5e0e4816 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:21.259752 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:21.415269 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-45a4d588-e3d1-4a08-af2f-67ad5e0e4816 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:21.424515 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-45a4d588-e3d1-4a08-af2f-67ad5e0e4816 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.186566 Aug 24 08:58:21.425102 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 232/462] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:21 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:21.817535 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0b257f1e-06b7-45e0-8868-6248064aa96a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:21.818259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0b257f1e-06b7-45e0-8868-6248064aa96a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:21.829362 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b257f1e-06b7-45e0-8868-6248064aa96a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:21.829857 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b257f1e-06b7-45e0-8868-6248064aa96a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:21.830290 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b257f1e-06b7-45e0-8868-6248064aa96a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:21.831001 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b257f1e-06b7-45e0-8868-6248064aa96a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:21.831456 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b257f1e-06b7-45e0-8868-6248064aa96a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:21.831882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b257f1e-06b7-45e0-8868-6248064aa96a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:22.080261 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0b257f1e-06b7-45e0-8868-6248064aa96a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:22.089279 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0b257f1e-06b7-45e0-8868-6248064aa96a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 200 len: 1502 microversion: 2.1 time: 0.276275 Aug 24 08:58:22.089860 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 231/463] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:21 2022] GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:22.447691 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-49fcfe2c-bb98-41c6-98de-63024d6fa9b2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:22.448309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-49fcfe2c-bb98-41c6-98de-63024d6fa9b2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:22.454499 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49fcfe2c-bb98-41c6-98de-63024d6fa9b2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:22.454986 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49fcfe2c-bb98-41c6-98de-63024d6fa9b2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:22.455426 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49fcfe2c-bb98-41c6-98de-63024d6fa9b2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:22.456177 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49fcfe2c-bb98-41c6-98de-63024d6fa9b2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:22.456639 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49fcfe2c-bb98-41c6-98de-63024d6fa9b2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:22.457062 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49fcfe2c-bb98-41c6-98de-63024d6fa9b2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:22.598775 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-49fcfe2c-bb98-41c6-98de-63024d6fa9b2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:22.613748 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-49fcfe2c-bb98-41c6-98de-63024d6fa9b2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.169843 Aug 24 08:58:22.620537 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 233/464] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:22 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:23.114157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-86c4aeec-cb62-4b22-b181-c5979ba78f47 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:23.115720 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-86c4aeec-cb62-4b22-b181-c5979ba78f47 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:23.124482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86c4aeec-cb62-4b22-b181-c5979ba78f47 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:23.124927 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86c4aeec-cb62-4b22-b181-c5979ba78f47 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:23.125583 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86c4aeec-cb62-4b22-b181-c5979ba78f47 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:23.126493 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86c4aeec-cb62-4b22-b181-c5979ba78f47 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:23.126964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86c4aeec-cb62-4b22-b181-c5979ba78f47 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:23.127427 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-86c4aeec-cb62-4b22-b181-c5979ba78f47 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:23.382413 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-5b12cc4c-4ebd-45f8-a3a3-11b2dd0b95f0 req-cf3d2871-c537-461b-a7a4-7f1b90b92107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51596c50-f87f-4eeb-bb50-c743b2a826f1", "name": "network-vif-deleted", "tag": "57cc5137-bfce-4d25-b98f-9746ad78a0a0"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:23.385129 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-86c4aeec-cb62-4b22-b181-c5979ba78f47 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3095e7f94a58497c812890fa86e08eec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61de8fb05c3a45de90ff3238b61452bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:23.394869 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-86c4aeec-cb62-4b22-b181-c5979ba78f47 tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 200 len: 1502 microversion: 2.1 time: 0.286017 Aug 24 08:58:23.395165 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 232/465] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:23 2022] GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 1502 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:23.397605 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5b12cc4c-4ebd-45f8-a3a3-11b2dd0b95f0 req-cf3d2871-c537-461b-a7a4-7f1b90b92107 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:23.398098 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5b12cc4c-4ebd-45f8-a3a3-11b2dd0b95f0 req-cf3d2871-c537-461b-a7a4-7f1b90b92107 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:23.399120 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-5b12cc4c-4ebd-45f8-a3a3-11b2dd0b95f0 req-cf3d2871-c537-461b-a7a4-7f1b90b92107 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:23.416766 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-5b12cc4c-4ebd-45f8-a3a3-11b2dd0b95f0 req-cf3d2871-c537-461b-a7a4-7f1b90b92107 service nova] Creating event network-vif-deleted:57cc5137-bfce-4d25-b98f-9746ad78a0a0 for instance 51596c50-f87f-4eeb-bb50-c743b2a826f1 on hv-cinder-83538 Aug 24 08:58:23.422871 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-5b12cc4c-4ebd-45f8-a3a3-11b2dd0b95f0 req-cf3d2871-c537-461b-a7a4-7f1b90b92107 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043999 Aug 24 08:58:23.423495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 234/466] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:58:23.636653 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7477cc72-10d6-4429-b165-a75d1d7b1396 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:23.637269 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7477cc72-10d6-4429-b165-a75d1d7b1396 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:23.643290 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7477cc72-10d6-4429-b165-a75d1d7b1396 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:23.643776 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7477cc72-10d6-4429-b165-a75d1d7b1396 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:23.644234 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7477cc72-10d6-4429-b165-a75d1d7b1396 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:23.644926 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7477cc72-10d6-4429-b165-a75d1d7b1396 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:23.645383 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7477cc72-10d6-4429-b165-a75d1d7b1396 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:23.645806 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7477cc72-10d6-4429-b165-a75d1d7b1396 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:23.782086 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7477cc72-10d6-4429-b165-a75d1d7b1396 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:23.790132 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7477cc72-10d6-4429-b165-a75d1d7b1396 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.157977 Aug 24 08:58:23.791050 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 233/467] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:23 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:24.418244 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9669ba5-24dc-4a1e-8ce2-5d177e25db3a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:24.419701 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c9669ba5-24dc-4a1e-8ce2-5d177e25db3a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] [instance: 51596c50-f87f-4eeb-bb50-c743b2a826f1] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:24.426230 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9669ba5-24dc-4a1e-8ce2-5d177e25db3a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:24.426812 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9669ba5-24dc-4a1e-8ce2-5d177e25db3a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:24.427326 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9669ba5-24dc-4a1e-8ce2-5d177e25db3a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:24.428033 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9669ba5-24dc-4a1e-8ce2-5d177e25db3a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:24.428528 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9669ba5-24dc-4a1e-8ce2-5d177e25db3a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:24.428956 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9669ba5-24dc-4a1e-8ce2-5d177e25db3a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:24.443495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-c9669ba5-24dc-4a1e-8ce2-5d177e25db3a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] HTTP exception thrown: Instance 51596c50-f87f-4eeb-bb50-c743b2a826f1 could not be found. Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9669ba5-24dc-4a1e-8ce2-5d177e25db3a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Request method failure captured: Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 HTTP/1.1 Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBef3Uq_le5phuv6dO0xK9G-lomNpF87npX75RXZi5-xcEEbdSfA8C59f746c_G9aFAYZlNPhaZzb52-Dz3Foqve2HBMCf545BZ4NK94DZBXQUlvTaxZxIchgIszeVCsChudMVmezAf_pIQfgq73tE-T4h41sSNxliPm2GGXS43r8ay8 Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 61de8fb05c3a45de90ff3238b61452bb Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-VolumesActionsTest-1839736605 Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 08:58:24.445702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 08:58:24.447400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_61de8fb05c3a45de90ff3238b61452bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/61de8fb05c3a45de90ff3238b61452bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/61de8fb05c3a45de90ff3238b61452bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/61de8fb05c3a45de90ff3238b61452bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:58:24.447400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-VolumesActionsTest-1839736605 Aug 24 08:58:24.447400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 61de8fb05c3a45de90ff3238b61452bb Aug 24 08:58:24.447400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-VolumesActionsTest-1839736605 Aug 24 08:58:24.447400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-VolumesActionsTest-1839736605-project Aug 24 08:58:24.447400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 08:58:24.447400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 08:58:24.447400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: 3095e7f94a58497c812890fa86e08eec Aug 24 08:58:24.447400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-VolumesActionsTest-1839736605-project Aug 24 08:58:24.447400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 08:58:24.447400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance 51596c50-f87f-4eeb-bb50-c743b2a826f1 could not be found. Aug 24 08:58:24.447400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '51596c50-f87f-4eeb-bb50-c743b2a826f1'} Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51596c50-f87f-4eeb-bb50-c743b2a826f1 could not be found. Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:58:24.448271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51596c50-f87f-4eeb-bb50-c743b2a826f1 could not be found. Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51596c50-f87f-4eeb-bb50-c743b2a826f1 could not be found. Aug 24 08:58:24.449653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 08:58:24.450807 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9669ba5-24dc-4a1e-8ce2-5d177e25db3a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] Returning 404 to user: Instance 51596c50-f87f-4eeb-bb50-c743b2a826f1 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:58:24.450807 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c9669ba5-24dc-4a1e-8ce2-5d177e25db3a tempest-VolumesActionsTest-1839736605 tempest-VolumesActionsTest-1839736605-project] 10.222.0.67 "GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1" status: 404 len: 111 microversion: 2.1 time: 0.033837 Aug 24 08:58:24.450807 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 235/468] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:24 2022] GET /compute/v2.1/servers/51596c50-f87f-4eeb-bb50-c743b2a826f1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 08:58:24.812067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-662d9892-8209-4bdb-8115-771ce95b3bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:24.813406 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-662d9892-8209-4bdb-8115-771ce95b3bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:24.824359 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-662d9892-8209-4bdb-8115-771ce95b3bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:24.824359 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-662d9892-8209-4bdb-8115-771ce95b3bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:24.824359 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-662d9892-8209-4bdb-8115-771ce95b3bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:24.824359 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-662d9892-8209-4bdb-8115-771ce95b3bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:24.824812 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-662d9892-8209-4bdb-8115-771ce95b3bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:24.824812 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-662d9892-8209-4bdb-8115-771ce95b3bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:25.018530 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-662d9892-8209-4bdb-8115-771ce95b3bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:25.021329 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:25.029163 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-662d9892-8209-4bdb-8115-771ce95b3bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.221475 Aug 24 08:58:25.043029 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 234/469] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:24 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:26.050400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9e429b2b-9146-4a7f-9fe0-d86338558b0b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:26.051033 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9e429b2b-9146-4a7f-9fe0-d86338558b0b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:26.058035 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e429b2b-9146-4a7f-9fe0-d86338558b0b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:26.058600 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e429b2b-9146-4a7f-9fe0-d86338558b0b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:26.059073 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e429b2b-9146-4a7f-9fe0-d86338558b0b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:26.059860 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e429b2b-9146-4a7f-9fe0-d86338558b0b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:26.060381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e429b2b-9146-4a7f-9fe0-d86338558b0b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:26.060803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e429b2b-9146-4a7f-9fe0-d86338558b0b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:26.200310 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9e429b2b-9146-4a7f-9fe0-d86338558b0b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:26.208400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9e429b2b-9146-4a7f-9fe0-d86338558b0b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.161910 Aug 24 08:58:26.209173 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 236/470] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:26 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:27.231288 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5f422746-f33c-4358-b72b-7eb894ebc4c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:27.232053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5f422746-f33c-4358-b72b-7eb894ebc4c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:27.239651 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f422746-f33c-4358-b72b-7eb894ebc4c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:27.240171 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f422746-f33c-4358-b72b-7eb894ebc4c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:27.240622 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f422746-f33c-4358-b72b-7eb894ebc4c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:27.241328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f422746-f33c-4358-b72b-7eb894ebc4c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:27.241790 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f422746-f33c-4358-b72b-7eb894ebc4c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:27.242289 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5f422746-f33c-4358-b72b-7eb894ebc4c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:27.404144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5f422746-f33c-4358-b72b-7eb894ebc4c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:27.413588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5f422746-f33c-4358-b72b-7eb894ebc4c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.187773 Aug 24 08:58:27.414816 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 235/471] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:27 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:28.436034 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ed44b1fe-ba83-4ffa-b671-ab9c9fd0f992 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:28.436709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ed44b1fe-ba83-4ffa-b671-ab9c9fd0f992 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:28.443093 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed44b1fe-ba83-4ffa-b671-ab9c9fd0f992 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:28.443637 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed44b1fe-ba83-4ffa-b671-ab9c9fd0f992 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:28.444082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed44b1fe-ba83-4ffa-b671-ab9c9fd0f992 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:28.444825 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed44b1fe-ba83-4ffa-b671-ab9c9fd0f992 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:28.445289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed44b1fe-ba83-4ffa-b671-ab9c9fd0f992 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:28.446314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ed44b1fe-ba83-4ffa-b671-ab9c9fd0f992 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:28.582272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ed44b1fe-ba83-4ffa-b671-ab9c9fd0f992 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:28.590377 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ed44b1fe-ba83-4ffa-b671-ab9c9fd0f992 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.158275 Aug 24 08:58:28.590957 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 237/472] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:28 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:29.611775 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-54bd368b-6194-440d-b20e-83670cbc7fe0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:29.612615 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-54bd368b-6194-440d-b20e-83670cbc7fe0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:29.622253 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54bd368b-6194-440d-b20e-83670cbc7fe0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:29.623182 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54bd368b-6194-440d-b20e-83670cbc7fe0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:29.624251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54bd368b-6194-440d-b20e-83670cbc7fe0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:29.625199 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54bd368b-6194-440d-b20e-83670cbc7fe0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:29.625999 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54bd368b-6194-440d-b20e-83670cbc7fe0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:29.626768 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-54bd368b-6194-440d-b20e-83670cbc7fe0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:29.805475 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-54bd368b-6194-440d-b20e-83670cbc7fe0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:29.824351 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-54bd368b-6194-440d-b20e-83670cbc7fe0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.216116 Aug 24 08:58:29.825110 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 236/473] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:29 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:30.847087 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cd34ec7e-9af9-4013-9642-5f99b78fd2a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:30.847698 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cd34ec7e-9af9-4013-9642-5f99b78fd2a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:30.854492 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd34ec7e-9af9-4013-9642-5f99b78fd2a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:30.854988 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd34ec7e-9af9-4013-9642-5f99b78fd2a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:30.855430 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd34ec7e-9af9-4013-9642-5f99b78fd2a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:30.856164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd34ec7e-9af9-4013-9642-5f99b78fd2a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:30.856630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd34ec7e-9af9-4013-9642-5f99b78fd2a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:30.857062 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd34ec7e-9af9-4013-9642-5f99b78fd2a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:31.000982 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cd34ec7e-9af9-4013-9642-5f99b78fd2a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:31.007471 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cd34ec7e-9af9-4013-9642-5f99b78fd2a8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.164344 Aug 24 08:58:31.008692 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 238/474] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:30 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:32.030046 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-938230ed-67d5-43ff-a75b-d9eee1ade010 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:32.031534 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-938230ed-67d5-43ff-a75b-d9eee1ade010 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:32.038064 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-938230ed-67d5-43ff-a75b-d9eee1ade010 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:32.038557 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-938230ed-67d5-43ff-a75b-d9eee1ade010 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:32.038995 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-938230ed-67d5-43ff-a75b-d9eee1ade010 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:32.039945 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-938230ed-67d5-43ff-a75b-d9eee1ade010 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:32.040438 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-938230ed-67d5-43ff-a75b-d9eee1ade010 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:32.040974 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-938230ed-67d5-43ff-a75b-d9eee1ade010 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:32.353167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-938230ed-67d5-43ff-a75b-d9eee1ade010 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:32.368781 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-938230ed-67d5-43ff-a75b-d9eee1ade010 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.342783 Aug 24 08:58:32.369603 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 237/475] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:32 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:33.406139 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1ac353f6-6fac-4a01-8edf-822adde667a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:33.407440 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1ac353f6-6fac-4a01-8edf-822adde667a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:33.414155 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ac353f6-6fac-4a01-8edf-822adde667a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:33.415938 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ac353f6-6fac-4a01-8edf-822adde667a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:33.416914 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ac353f6-6fac-4a01-8edf-822adde667a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:33.417847 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ac353f6-6fac-4a01-8edf-822adde667a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:33.418502 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ac353f6-6fac-4a01-8edf-822adde667a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:33.419108 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ac353f6-6fac-4a01-8edf-822adde667a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:33.574193 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1ac353f6-6fac-4a01-8edf-822adde667a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:33.583078 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1ac353f6-6fac-4a01-8edf-822adde667a2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.181442 Aug 24 08:58:33.583712 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 239/476] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:33 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:34.620807 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-04c86c08-3c7a-4753-966b-53d81ed02a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:34.623785 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-04c86c08-3c7a-4753-966b-53d81ed02a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:34.629346 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:34.637293 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04c86c08-3c7a-4753-966b-53d81ed02a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:34.637986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04c86c08-3c7a-4753-966b-53d81ed02a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:34.638433 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04c86c08-3c7a-4753-966b-53d81ed02a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:34.639158 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04c86c08-3c7a-4753-966b-53d81ed02a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:34.639622 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04c86c08-3c7a-4753-966b-53d81ed02a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:34.640054 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04c86c08-3c7a-4753-966b-53d81ed02a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:34.921297 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-04c86c08-3c7a-4753-966b-53d81ed02a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:34.935265 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-04c86c08-3c7a-4753-966b-53d81ed02a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.325123 Aug 24 08:58:34.935862 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 238/477] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:34 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:58:35.964150 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2f41f213-6b4a-4ea5-a5ef-d473811f2a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:35.965756 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2f41f213-6b4a-4ea5-a5ef-d473811f2a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:35.976594 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=52 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:35.979538 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f41f213-6b4a-4ea5-a5ef-d473811f2a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:35.980746 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f41f213-6b4a-4ea5-a5ef-d473811f2a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:35.981986 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f41f213-6b4a-4ea5-a5ef-d473811f2a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:35.983568 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f41f213-6b4a-4ea5-a5ef-d473811f2a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:35.984665 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f41f213-6b4a-4ea5-a5ef-d473811f2a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:35.985667 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f41f213-6b4a-4ea5-a5ef-d473811f2a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:36.244784 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2f41f213-6b4a-4ea5-a5ef-d473811f2a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:36.255928 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2f41f213-6b4a-4ea5-a5ef-d473811f2a05 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.301574 Aug 24 08:58:36.257237 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 240/478] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:35 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:37.298727 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3c11fbd4-7709-4489-b535-e0c42aeb1482 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:37.301298 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3c11fbd4-7709-4489-b535-e0c42aeb1482 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:37.328555 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c11fbd4-7709-4489-b535-e0c42aeb1482 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:37.329744 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c11fbd4-7709-4489-b535-e0c42aeb1482 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:37.330671 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c11fbd4-7709-4489-b535-e0c42aeb1482 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:37.332346 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c11fbd4-7709-4489-b535-e0c42aeb1482 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:37.333155 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c11fbd4-7709-4489-b535-e0c42aeb1482 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:37.333974 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3c11fbd4-7709-4489-b535-e0c42aeb1482 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:37.625197 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3c11fbd4-7709-4489-b535-e0c42aeb1482 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:37.637946 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3c11fbd4-7709-4489-b535-e0c42aeb1482 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.348763 Aug 24 08:58:37.652886 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 239/479] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:37 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:38.674202 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8b2c26c0-8198-4554-9fb7-c4a59371dda4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:38.675861 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8b2c26c0-8198-4554-9fb7-c4a59371dda4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:38.683346 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b2c26c0-8198-4554-9fb7-c4a59371dda4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:38.684133 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b2c26c0-8198-4554-9fb7-c4a59371dda4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:38.684753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b2c26c0-8198-4554-9fb7-c4a59371dda4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:38.685671 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b2c26c0-8198-4554-9fb7-c4a59371dda4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:38.686417 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b2c26c0-8198-4554-9fb7-c4a59371dda4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:38.687058 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b2c26c0-8198-4554-9fb7-c4a59371dda4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:38.908069 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8b2c26c0-8198-4554-9fb7-c4a59371dda4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:38.919089 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8b2c26c0-8198-4554-9fb7-c4a59371dda4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.248775 Aug 24 08:58:38.919991 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 241/480] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:38 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:39.940355 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c75e7c6-019e-4176-b3f2-fb2fe06d230d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:39.940936 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1c75e7c6-019e-4176-b3f2-fb2fe06d230d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:39.949077 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c75e7c6-019e-4176-b3f2-fb2fe06d230d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:39.949949 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c75e7c6-019e-4176-b3f2-fb2fe06d230d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:39.950627 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c75e7c6-019e-4176-b3f2-fb2fe06d230d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:39.951585 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c75e7c6-019e-4176-b3f2-fb2fe06d230d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:39.952274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c75e7c6-019e-4176-b3f2-fb2fe06d230d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:39.953052 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c75e7c6-019e-4176-b3f2-fb2fe06d230d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:40.131617 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1c75e7c6-019e-4176-b3f2-fb2fe06d230d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:40.140690 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1c75e7c6-019e-4176-b3f2-fb2fe06d230d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.204388 Aug 24 08:58:40.152146 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 240/481] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:39 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:41.166495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-56a981c1-1cc5-4e29-8687-76667ae9b75f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:41.167324 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-56a981c1-1cc5-4e29-8687-76667ae9b75f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:41.174498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56a981c1-1cc5-4e29-8687-76667ae9b75f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:41.175113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56a981c1-1cc5-4e29-8687-76667ae9b75f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:41.175633 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56a981c1-1cc5-4e29-8687-76667ae9b75f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:41.176579 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56a981c1-1cc5-4e29-8687-76667ae9b75f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:41.177551 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56a981c1-1cc5-4e29-8687-76667ae9b75f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:41.178285 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56a981c1-1cc5-4e29-8687-76667ae9b75f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:41.334221 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-56a981c1-1cc5-4e29-8687-76667ae9b75f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:41.344262 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-56a981c1-1cc5-4e29-8687-76667ae9b75f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.182718 Aug 24 08:58:41.344953 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 242/482] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:41 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:42.371651 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fc4fc437-a07e-415d-9ff5-3cbc769d731a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:42.372755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fc4fc437-a07e-415d-9ff5-3cbc769d731a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:42.384464 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc4fc437-a07e-415d-9ff5-3cbc769d731a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:42.385661 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc4fc437-a07e-415d-9ff5-3cbc769d731a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:42.386346 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc4fc437-a07e-415d-9ff5-3cbc769d731a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:42.387517 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc4fc437-a07e-415d-9ff5-3cbc769d731a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:42.388120 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc4fc437-a07e-415d-9ff5-3cbc769d731a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:42.388566 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc4fc437-a07e-415d-9ff5-3cbc769d731a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:42.595529 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-fc4fc437-a07e-415d-9ff5-3cbc769d731a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:42.604573 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fc4fc437-a07e-415d-9ff5-3cbc769d731a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.241244 Aug 24 08:58:42.605260 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 241/483] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:42 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:43.639064 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1fc14c88-8ecc-499a-aec2-95fca95cee08 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:43.640695 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1fc14c88-8ecc-499a-aec2-95fca95cee08 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:43.648451 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fc14c88-8ecc-499a-aec2-95fca95cee08 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:43.649246 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fc14c88-8ecc-499a-aec2-95fca95cee08 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:43.650498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fc14c88-8ecc-499a-aec2-95fca95cee08 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:43.651579 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fc14c88-8ecc-499a-aec2-95fca95cee08 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:43.652358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fc14c88-8ecc-499a-aec2-95fca95cee08 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:43.653268 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fc14c88-8ecc-499a-aec2-95fca95cee08 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:43.819697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1fc14c88-8ecc-499a-aec2-95fca95cee08 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:43.829247 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1fc14c88-8ecc-499a-aec2-95fca95cee08 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.194143 Aug 24 08:58:43.832202 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 243/484] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:43 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:44.857434 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e7c8c0d4-a12a-4955-945f-21ff3fe08b79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:44.858735 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e7c8c0d4-a12a-4955-945f-21ff3fe08b79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:44.869063 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7c8c0d4-a12a-4955-945f-21ff3fe08b79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:44.869560 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7c8c0d4-a12a-4955-945f-21ff3fe08b79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:44.870053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7c8c0d4-a12a-4955-945f-21ff3fe08b79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:44.870800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7c8c0d4-a12a-4955-945f-21ff3fe08b79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:44.871263 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7c8c0d4-a12a-4955-945f-21ff3fe08b79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:44.871710 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e7c8c0d4-a12a-4955-945f-21ff3fe08b79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:45.094010 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e7c8c0d4-a12a-4955-945f-21ff3fe08b79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:45.109180 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e7c8c0d4-a12a-4955-945f-21ff3fe08b79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.261460 Aug 24 08:58:45.110290 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 242/485] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:44 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:46.148202 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2049ac8c-e4f9-4252-a57c-8e53feea07f4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:46.152414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2049ac8c-e4f9-4252-a57c-8e53feea07f4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:46.166131 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2049ac8c-e4f9-4252-a57c-8e53feea07f4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:46.168254 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2049ac8c-e4f9-4252-a57c-8e53feea07f4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:46.171852 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2049ac8c-e4f9-4252-a57c-8e53feea07f4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:46.177177 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2049ac8c-e4f9-4252-a57c-8e53feea07f4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:46.179388 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2049ac8c-e4f9-4252-a57c-8e53feea07f4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:46.185436 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2049ac8c-e4f9-4252-a57c-8e53feea07f4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:46.390181 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2049ac8c-e4f9-4252-a57c-8e53feea07f4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:46.400927 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2049ac8c-e4f9-4252-a57c-8e53feea07f4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.264464 Aug 24 08:58:46.402077 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 244/486] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:46 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:47.437725 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-26b2b239-b196-4530-9872-06c865316b30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:47.438685 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-26b2b239-b196-4530-9872-06c865316b30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:47.448964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26b2b239-b196-4530-9872-06c865316b30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:47.449763 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26b2b239-b196-4530-9872-06c865316b30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:47.451092 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26b2b239-b196-4530-9872-06c865316b30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:47.452168 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26b2b239-b196-4530-9872-06c865316b30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:47.453854 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26b2b239-b196-4530-9872-06c865316b30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:47.454579 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-26b2b239-b196-4530-9872-06c865316b30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:47.630730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-26b2b239-b196-4530-9872-06c865316b30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:47.640308 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-26b2b239-b196-4530-9872-06c865316b30 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.209326 Aug 24 08:58:47.641556 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 243/487] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:47 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:48.663279 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8e6001d8-2aa1-41f7-b8c4-249ed32dcf93 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:48.664086 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8e6001d8-2aa1-41f7-b8c4-249ed32dcf93 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:48.672580 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e6001d8-2aa1-41f7-b8c4-249ed32dcf93 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:48.673340 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e6001d8-2aa1-41f7-b8c4-249ed32dcf93 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:48.673963 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e6001d8-2aa1-41f7-b8c4-249ed32dcf93 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:48.674866 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e6001d8-2aa1-41f7-b8c4-249ed32dcf93 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:48.675330 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e6001d8-2aa1-41f7-b8c4-249ed32dcf93 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:48.675852 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e6001d8-2aa1-41f7-b8c4-249ed32dcf93 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:48.831028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8e6001d8-2aa1-41f7-b8c4-249ed32dcf93 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:48.840569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8e6001d8-2aa1-41f7-b8c4-249ed32dcf93 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1501 microversion: 2.1 time: 0.181487 Aug 24 08:58:48.841382 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 245/488] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:48 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1501 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:48.862486 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a68824eb-c7a7-41f4-a059-43312be69c89 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ea4ddeb-1a25-43c7-9c66-bf53fcf8e836"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:48.865291 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a68824eb-c7a7-41f4-a059-43312be69c89 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:48.873889 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a68824eb-c7a7-41f4-a059-43312be69c89 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:48.874639 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a68824eb-c7a7-41f4-a059-43312be69c89 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:48.875563 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a68824eb-c7a7-41f4-a059-43312be69c89 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:48.876698 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a68824eb-c7a7-41f4-a059-43312be69c89 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:48.877349 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a68824eb-c7a7-41f4-a059-43312be69c89 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:48.877960 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a68824eb-c7a7-41f4-a059-43312be69c89 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:48.907076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-a68824eb-c7a7-41f4-a059-43312be69c89 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] HTTP exception thrown: Cannot 'attach_volume' instance d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 while it is in vm_state rescued Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a68824eb-c7a7-41f4-a059-43312be69c89 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Request method failure captured: Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8/os-volume_attachments HTTP/1.1 Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 74 Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeQeb4NIRtpVDGaM1J2L0qDK5-xS8gcYMDBqdKvfZAFL7ABp5_RCKRstcrKGyfoShIdeqdE9FKD_wQVDFs9jrdbmlMmvZ597IzHE58w9lVMS0yxPRKMLsSi3X7uPLg36ZykjHg2NXN8EaoZqvJzoNTzXyNha6h0XTNQDcUxBGp-fxM Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: b5cb111df3ec4249a836518a598063a4 Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-363289357 Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 08:58:48.908818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 08:58:48.910441 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b5cb111df3ec4249a836518a598063a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b5cb111df3ec4249a836518a598063a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b5cb111df3ec4249a836518a598063a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b5cb111df3ec4249a836518a598063a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 08:58:48.910441 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-ServerRescueNegativeTestJSON-363289357 Aug 24 08:58:48.910441 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: b5cb111df3ec4249a836518a598063a4 Aug 24 08:58:48.910441 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-363289357 Aug 24 08:58:48.910441 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-ServerRescueNegativeTestJSON-363289357-project Aug 24 08:58:48.910441 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 08:58:48.910441 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 08:58:48.910441 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: 8ee5364270094596b64b08a8ac56f6ce Aug 24 08:58:48.910441 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-ServerRescueNegativeTestJSON-363289357-project Aug 24 08:58:48.910441 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Aug 24 08:58:48.910441 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {"volumeAttachment": {"volumeId": "0ea4ddeb-1a25-43c7-9c66-bf53fcf8e836"}} Aug 24 08:58:48.910441 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Cannot 'attach_volume' instance d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 while it is in vm_state rescued Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'server_id': 'd6cadaae-8d3b-485a-87a8-cdf9b320b2b8', 'body': {'volumeAttachment': {'volumeId': '0ea4ddeb-1a25-43c7-9c66-bf53fcf8e836'}}} Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 08:58:48.911372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 while it is in vm_state rescued Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 08:58:48.912852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 08:58:48.915082 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 08:58:48.915082 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 08:58:48.915082 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 while it is in vm_state rescued Aug 24 08:58:48.915082 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 08:58:48.915082 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a68824eb-c7a7-41f4-a059-43312be69c89 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Returning 409 to user: Cannot 'attach_volume' instance d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 while it is in vm_state rescued {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 08:58:48.915082 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a68824eb-c7a7-41f4-a059-43312be69c89 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "POST /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052300 Aug 24 08:58:48.915082 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 244/489] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 24 08:58:48 2022] POST /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 08:58:48.920488 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e9091207-c5f9-48a4-b878-cf015f0e9edd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:48.921164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e9091207-c5f9-48a4-b878-cf015f0e9edd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:48.934337 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9091207-c5f9-48a4-b878-cf015f0e9edd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:48.935058 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9091207-c5f9-48a4-b878-cf015f0e9edd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:48.935511 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9091207-c5f9-48a4-b878-cf015f0e9edd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:48.936292 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9091207-c5f9-48a4-b878-cf015f0e9edd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:48.936761 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9091207-c5f9-48a4-b878-cf015f0e9edd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:48.937188 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9091207-c5f9-48a4-b878-cf015f0e9edd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:49.033864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e9091207-c5f9-48a4-b878-cf015f0e9edd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "POST /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8/action" status: 202 len: 0 microversion: 2.1 time: 0.116934 Aug 24 08:58:49.033864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 246/490] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 24 08:58:48 2022] POST /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:58:49.042736 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8cd09eb4-d340-44d5-8d8e-dca7e47c00a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:49.043080 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8cd09eb4-d340-44d5-8d8e-dca7e47c00a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:49.051065 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cd09eb4-d340-44d5-8d8e-dca7e47c00a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:49.052693 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cd09eb4-d340-44d5-8d8e-dca7e47c00a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:49.053326 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cd09eb4-d340-44d5-8d8e-dca7e47c00a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:49.054236 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cd09eb4-d340-44d5-8d8e-dca7e47c00a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:49.055059 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cd09eb4-d340-44d5-8d8e-dca7e47c00a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:49.055645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8cd09eb4-d340-44d5-8d8e-dca7e47c00a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:49.364847 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8cd09eb4-d340-44d5-8d8e-dca7e47c00a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:49.380208 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8cd09eb4-d340-44d5-8d8e-dca7e47c00a1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1509 microversion: 2.1 time: 0.342323 Aug 24 08:58:49.394566 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 245/491] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:49 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1509 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:50.403824 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1ecc3cbd-e833-4ab2-af4f-3fed2f19cac8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:50.404556 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1ecc3cbd-e833-4ab2-af4f-3fed2f19cac8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:50.411101 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ecc3cbd-e833-4ab2-af4f-3fed2f19cac8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:50.411610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ecc3cbd-e833-4ab2-af4f-3fed2f19cac8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:50.412051 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ecc3cbd-e833-4ab2-af4f-3fed2f19cac8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:50.412789 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ecc3cbd-e833-4ab2-af4f-3fed2f19cac8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:50.413440 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ecc3cbd-e833-4ab2-af4f-3fed2f19cac8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:50.413860 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1ecc3cbd-e833-4ab2-af4f-3fed2f19cac8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:50.879859 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1ecc3cbd-e833-4ab2-af4f-3fed2f19cac8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:50.893304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1ecc3cbd-e833-4ab2-af4f-3fed2f19cac8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1509 microversion: 2.1 time: 0.494273 Aug 24 08:58:50.894771 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 247/492] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:50 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1509 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:51.914850 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-98b990d4-72b2-4dce-a3dc-29b1422885c3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:51.917306 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-98b990d4-72b2-4dce-a3dc-29b1422885c3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:51.923096 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98b990d4-72b2-4dce-a3dc-29b1422885c3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:51.923715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98b990d4-72b2-4dce-a3dc-29b1422885c3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:51.924290 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98b990d4-72b2-4dce-a3dc-29b1422885c3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:51.925102 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98b990d4-72b2-4dce-a3dc-29b1422885c3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:51.925669 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98b990d4-72b2-4dce-a3dc-29b1422885c3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:51.926199 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98b990d4-72b2-4dce-a3dc-29b1422885c3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:52.311709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-98b990d4-72b2-4dce-a3dc-29b1422885c3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:52.329725 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-98b990d4-72b2-4dce-a3dc-29b1422885c3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1509 microversion: 2.1 time: 0.418369 Aug 24 08:58:52.331899 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 246/493] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:51 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1509 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:53.352010 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1fb9f798-621e-4be7-986c-84634b002a1f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:58:53.352975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1fb9f798-621e-4be7-986c-84634b002a1f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:58:53.359632 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fb9f798-621e-4be7-986c-84634b002a1f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:53.360971 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fb9f798-621e-4be7-986c-84634b002a1f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:53.361410 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fb9f798-621e-4be7-986c-84634b002a1f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:53.362122 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fb9f798-621e-4be7-986c-84634b002a1f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:53.362580 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fb9f798-621e-4be7-986c-84634b002a1f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:53.363002 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1fb9f798-621e-4be7-986c-84634b002a1f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:53.376368 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:53.735200 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1fb9f798-621e-4be7-986c-84634b002a1f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:58:53.749652 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1fb9f798-621e-4be7-986c-84634b002a1f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1515 microversion: 2.1 time: 0.401390 Aug 24 08:58:53.760132 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 248/494] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:58:53 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1515 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:58:55.305118 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ccb4dbac-9ade-4d78-8b06-99c5d536ef54 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Action: 'create', calling method: .version_select at 0x7fb140f7cf70>, body: {"keypair": {"name": "tempest-keypair-519484868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGG3bUxaCuDu0pW88+3NQNFsgzE7TKlRximm52PwoewS57xqRK0gxftyOgOLrehsJmVK6UQUAQw3DG1dMTW4xNPf2HG5DtQkGkMSukg+rPSXKxFhJACdqqLNUiSOkISRA=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:55.323544 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-ccb4dbac-9ade-4d78-8b06-99c5d536ef54 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Getting quotas for project b5cb111df3ec4249a836518a598063a4. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:58:55.327772 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-ccb4dbac-9ade-4d78-8b06-99c5d536ef54 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Getting quotas for user 8ee5364270094596b64b08a8ac56f6ce and project b5cb111df3ec4249a836518a598063a4. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:58:55.342949 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ccb4dbac-9ade-4d78-8b06-99c5d536ef54 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [c9748255-660a-46ae-adc2-0d73850c68e1] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 08:58:56.366692 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [None req-ccb4dbac-9ade-4d78-8b06-99c5d536ef54 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [c9748255-660a-46ae-adc2-0d73850c68e1] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 46758. Aug 24 08:58:56.385902 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ccb4dbac-9ade-4d78-8b06-99c5d536ef54 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.084132 Aug 24 08:58:56.386528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 247/495] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 24 08:58:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:58:58.445800 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-224840481", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c053db24-71f7-49c0-865c-6fe9c343616a"}], "security_groups": [{"name": "tempest-securitygroup--1539605746"}], "key_name": "tempest-keypair-519484868", "user_data": "}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:58:58.684286 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] validate_networks() for [('c053db24-71f7-49c0-865c-6fe9c343616a', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:58:59.565729 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:58:59.566330 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:58:59.566844 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:58:59.567319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:58:59.567807 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:58:59.579437 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:59.580043 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:59.580602 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:59.581448 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:58:59.581998 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:58:59.582496 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:58:59.602032 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Getting quotas for project b5cb111df3ec4249a836518a598063a4. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:58:59.607756 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Getting quotas for user 8ee5364270094596b64b08a8ac56f6ce and project b5cb111df3ec4249a836518a598063a4. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:58:59.620503 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:58:59.623491 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:58:59.706504 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [2cc0e56a-1627-4cc7-ae5e-451c2b796f75] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 08:59:00.729623 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [2cc0e56a-1627-4cc7-ae5e-451c2b796f75] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 46828. Aug 24 08:59:00.759280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d84264c5-c576-4029-8196-80481a561d18 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.317841 Aug 24 08:59:00.770605 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 249/496] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 08:58:58 2022] POST /compute/v2.1/servers => generated 409 bytes in 2330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 08:59:00.774539 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a01db8b1-9c38-4103-8814-4378b4366e25 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:00.775158 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a01db8b1-9c38-4103-8814-4378b4366e25 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:00.941215 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a01db8b1-9c38-4103-8814-4378b4366e25 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:00.950500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a01db8b1-9c38-4103-8814-4378b4366e25 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1244 microversion: 2.1 time: 0.180349 Aug 24 08:59:00.962603 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 248/497] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:00 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1244 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:59:01.980373 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d5027705-9e44-4b5d-be6b-3974b8dbced6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:01.980993 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d5027705-9e44-4b5d-be6b-3974b8dbced6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:01.993642 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5027705-9e44-4b5d-be6b-3974b8dbced6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:01.994847 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5027705-9e44-4b5d-be6b-3974b8dbced6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:01.995541 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5027705-9e44-4b5d-be6b-3974b8dbced6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:01.997973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5027705-9e44-4b5d-be6b-3974b8dbced6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:01.999533 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5027705-9e44-4b5d-be6b-3974b8dbced6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:02.000477 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5027705-9e44-4b5d-be6b-3974b8dbced6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:02.121739 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d5027705-9e44-4b5d-be6b-3974b8dbced6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:02.135445 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d5027705-9e44-4b5d-be6b-3974b8dbced6 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1296 microversion: 2.1 time: 0.158481 Aug 24 08:59:02.136923 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 250/498] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:01 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1296 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:03.157375 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d37a3a6-bb93-4248-80df-33a7cf254133 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:03.158926 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d37a3a6-bb93-4248-80df-33a7cf254133 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:03.170295 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=71 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:03.187858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d37a3a6-bb93-4248-80df-33a7cf254133 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:03.195489 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d37a3a6-bb93-4248-80df-33a7cf254133 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:03.196398 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d37a3a6-bb93-4248-80df-33a7cf254133 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:03.202826 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d37a3a6-bb93-4248-80df-33a7cf254133 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:03.203676 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d37a3a6-bb93-4248-80df-33a7cf254133 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:03.204392 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d37a3a6-bb93-4248-80df-33a7cf254133 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:03.415664 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0d37a3a6-bb93-4248-80df-33a7cf254133 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:03.429177 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d37a3a6-bb93-4248-80df-33a7cf254133 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1302 microversion: 2.1 time: 0.275440 Aug 24 08:59:03.430041 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 249/499] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:03 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1302 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:03.763402 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3996e80f-62b5-4a17-b982-3e6e46ed68aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Action: 'create', calling method: .version_select at 0x7fb14180d550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1984818663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsOJuHSWIv9NLTyaf+J5hp7kppo1FsvEYKz5/Tk0tObA8ORyAQoV3jp8xpBMRlqgjq0j1mt6YHMXMz7Terfrp0i5R/LuLQMitW+5pnBhsDCK2trEcz7n2A/t83jvz/FDA=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:03.787477 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-3996e80f-62b5-4a17-b982-3e6e46ed68aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Getting quotas for project 080318594f144fa3852577bc02ee5357. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:59:03.798911 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-3996e80f-62b5-4a17-b982-3e6e46ed68aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Getting quotas for user 46b3aa99a5e84ef2a8df193628feb0d6 and project 080318594f144fa3852577bc02ee5357. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:59:03.881165 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3996e80f-62b5-4a17-b982-3e6e46ed68aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.353714 Aug 24 08:59:03.882352 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 251/500] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 24 08:59:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:59:04.452528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-633f213f-11a9-4332-9b45-79af7947a04b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:04.453202 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-633f213f-11a9-4332-9b45-79af7947a04b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:04.459933 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-633f213f-11a9-4332-9b45-79af7947a04b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:04.460656 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-633f213f-11a9-4332-9b45-79af7947a04b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:04.461299 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-633f213f-11a9-4332-9b45-79af7947a04b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:04.462241 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-633f213f-11a9-4332-9b45-79af7947a04b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:04.462988 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-633f213f-11a9-4332-9b45-79af7947a04b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:04.463650 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-633f213f-11a9-4332-9b45-79af7947a04b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:05.073405 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-633f213f-11a9-4332-9b45-79af7947a04b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:05.081942 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-633f213f-11a9-4332-9b45-79af7947a04b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1370 microversion: 2.1 time: 0.634737 Aug 24 08:59:05.098216 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 250/501] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:04 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1370 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:05.392001 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-f30507b7-8eac-477f-9c63-761b1eccc101 req-1f0b934a-6a47-482b-881a-516ba13b7e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e46c8263-fe1c-4e13-92a9-038085ee9ed8", "tag": "1bd5c04d-326a-446b-b57a-525d40d706b9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:05.426603 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f30507b7-8eac-477f-9c63-761b1eccc101 req-1f0b934a-6a47-482b-881a-516ba13b7e35 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:05.427401 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f30507b7-8eac-477f-9c63-761b1eccc101 req-1f0b934a-6a47-482b-881a-516ba13b7e35 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:05.428915 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-f30507b7-8eac-477f-9c63-761b1eccc101 req-1f0b934a-6a47-482b-881a-516ba13b7e35 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:05.442138 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-f30507b7-8eac-477f-9c63-761b1eccc101 req-1f0b934a-6a47-482b-881a-516ba13b7e35 service nova] Creating event network-changed:1bd5c04d-326a-446b-b57a-525d40d706b9 for instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 on hv-cinder-83538 Aug 24 08:59:05.454869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-f30507b7-8eac-477f-9c63-761b1eccc101 req-1f0b934a-6a47-482b-881a-516ba13b7e35 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063206 Aug 24 08:59:05.456863 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 252/502] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:59:06.105812 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ad413c93-1380-4eea-962b-8580b42e6438 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:06.107686 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ad413c93-1380-4eea-962b-8580b42e6438 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:06.110903 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:06.118195 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad413c93-1380-4eea-962b-8580b42e6438 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:06.118692 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad413c93-1380-4eea-962b-8580b42e6438 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:06.119821 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad413c93-1380-4eea-962b-8580b42e6438 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:06.120565 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad413c93-1380-4eea-962b-8580b42e6438 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:06.121912 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad413c93-1380-4eea-962b-8580b42e6438 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:06.122354 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad413c93-1380-4eea-962b-8580b42e6438 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:06.294669 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ad413c93-1380-4eea-962b-8580b42e6438 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:06.311377 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ad413c93-1380-4eea-962b-8580b42e6438 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1370 microversion: 2.1 time: 0.209578 Aug 24 08:59:06.327231 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 251/503] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:06 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:07.337191 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2466cd23-e056-4682-84d8-7d49802bc854 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:07.338007 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2466cd23-e056-4682-84d8-7d49802bc854 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:07.340441 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:07.355763 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2466cd23-e056-4682-84d8-7d49802bc854 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:07.356312 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2466cd23-e056-4682-84d8-7d49802bc854 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:07.356752 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2466cd23-e056-4682-84d8-7d49802bc854 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:07.358008 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2466cd23-e056-4682-84d8-7d49802bc854 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:07.360518 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2466cd23-e056-4682-84d8-7d49802bc854 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:07.361149 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2466cd23-e056-4682-84d8-7d49802bc854 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:07.574402 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2466cd23-e056-4682-84d8-7d49802bc854 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:07.584021 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2466cd23-e056-4682-84d8-7d49802bc854 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1370 microversion: 2.1 time: 0.251323 Aug 24 08:59:07.584021 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 253/504] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:07 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1370 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:08.605169 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f2867506-48a6-410e-8f57-ca97fc353c42 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:08.606120 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f2867506-48a6-410e-8f57-ca97fc353c42 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:08.613845 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2867506-48a6-410e-8f57-ca97fc353c42 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:08.614324 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2867506-48a6-410e-8f57-ca97fc353c42 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:08.614886 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2867506-48a6-410e-8f57-ca97fc353c42 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:08.616062 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2867506-48a6-410e-8f57-ca97fc353c42 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:08.616710 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2867506-48a6-410e-8f57-ca97fc353c42 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:08.617143 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f2867506-48a6-410e-8f57-ca97fc353c42 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:08.758826 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f2867506-48a6-410e-8f57-ca97fc353c42 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:08.767548 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f2867506-48a6-410e-8f57-ca97fc353c42 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1370 microversion: 2.1 time: 0.166689 Aug 24 08:59:08.768150 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 252/505] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:08 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:09.792669 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1a568949-f652-477e-b758-a779fb1868e2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:09.793292 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1a568949-f652-477e-b758-a779fb1868e2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:09.795175 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:09.800573 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a568949-f652-477e-b758-a779fb1868e2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:09.801068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a568949-f652-477e-b758-a779fb1868e2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:09.801515 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a568949-f652-477e-b758-a779fb1868e2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:09.802216 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a568949-f652-477e-b758-a779fb1868e2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:09.802678 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a568949-f652-477e-b758-a779fb1868e2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:09.803116 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1a568949-f652-477e-b758-a779fb1868e2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:09.941766 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1a568949-f652-477e-b758-a779fb1868e2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:09.951286 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1a568949-f652-477e-b758-a779fb1868e2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1370 microversion: 2.1 time: 0.163178 Aug 24 08:59:09.951872 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 254/506] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:09 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:10.972869 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c4e5e4a9-cfdf-4dfe-8612-bf184715b74e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:10.973477 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c4e5e4a9-cfdf-4dfe-8612-bf184715b74e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:10.975918 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:10.982393 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4e5e4a9-cfdf-4dfe-8612-bf184715b74e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:10.982914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4e5e4a9-cfdf-4dfe-8612-bf184715b74e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:10.983374 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4e5e4a9-cfdf-4dfe-8612-bf184715b74e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:10.984076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4e5e4a9-cfdf-4dfe-8612-bf184715b74e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:10.984556 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4e5e4a9-cfdf-4dfe-8612-bf184715b74e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:10.984978 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4e5e4a9-cfdf-4dfe-8612-bf184715b74e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:11.124256 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4e5e4a9-cfdf-4dfe-8612-bf184715b74e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:11.132640 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c4e5e4a9-cfdf-4dfe-8612-bf184715b74e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1370 microversion: 2.1 time: 0.163593 Aug 24 08:59:11.133229 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 253/507] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:10 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:12.154421 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-81dc61cd-96c2-4247-89a3-fd7e698fd75d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:12.155035 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-81dc61cd-96c2-4247-89a3-fd7e698fd75d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:12.161379 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81dc61cd-96c2-4247-89a3-fd7e698fd75d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:12.161927 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81dc61cd-96c2-4247-89a3-fd7e698fd75d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:12.162307 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81dc61cd-96c2-4247-89a3-fd7e698fd75d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:12.163009 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81dc61cd-96c2-4247-89a3-fd7e698fd75d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:12.163469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81dc61cd-96c2-4247-89a3-fd7e698fd75d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:12.163899 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-81dc61cd-96c2-4247-89a3-fd7e698fd75d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:12.314563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-81dc61cd-96c2-4247-89a3-fd7e698fd75d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:12.322539 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-81dc61cd-96c2-4247-89a3-fd7e698fd75d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1370 microversion: 2.1 time: 0.172803 Aug 24 08:59:12.323199 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 255/508] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:12 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:13.343031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9eaf3c96-b741-46c7-9f77-3d014b95a7a7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:13.343570 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9eaf3c96-b741-46c7-9f77-3d014b95a7a7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:13.350427 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eaf3c96-b741-46c7-9f77-3d014b95a7a7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:13.350915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eaf3c96-b741-46c7-9f77-3d014b95a7a7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:13.351347 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eaf3c96-b741-46c7-9f77-3d014b95a7a7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:13.352074 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eaf3c96-b741-46c7-9f77-3d014b95a7a7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:13.352547 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eaf3c96-b741-46c7-9f77-3d014b95a7a7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:13.352965 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9eaf3c96-b741-46c7-9f77-3d014b95a7a7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:13.492041 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9eaf3c96-b741-46c7-9f77-3d014b95a7a7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:13.500761 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9eaf3c96-b741-46c7-9f77-3d014b95a7a7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1370 microversion: 2.1 time: 0.161696 Aug 24 08:59:13.501331 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 254/509] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:13 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:14.522333 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3ce5afb4-195c-48fd-b60a-60b816dc073f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:14.522951 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3ce5afb4-195c-48fd-b60a-60b816dc073f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:14.524928 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=10 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:14.530252 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ce5afb4-195c-48fd-b60a-60b816dc073f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:14.530772 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ce5afb4-195c-48fd-b60a-60b816dc073f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:14.531221 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ce5afb4-195c-48fd-b60a-60b816dc073f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:14.531927 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ce5afb4-195c-48fd-b60a-60b816dc073f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:14.532461 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ce5afb4-195c-48fd-b60a-60b816dc073f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:14.532894 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ce5afb4-195c-48fd-b60a-60b816dc073f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:14.578196 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-bdc8303c-e4ca-444a-b39d-4219272701f7 req-ae57b69d-e1e4-425f-9fc0-7b625b04836b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e46c8263-fe1c-4e13-92a9-038085ee9ed8", "name": "network-vif-plugged", "status": "completed", "tag": "1bd5c04d-326a-446b-b57a-525d40d706b9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:14.588678 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bdc8303c-e4ca-444a-b39d-4219272701f7 req-ae57b69d-e1e4-425f-9fc0-7b625b04836b service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:14.589221 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bdc8303c-e4ca-444a-b39d-4219272701f7 req-ae57b69d-e1e4-425f-9fc0-7b625b04836b service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:14.589861 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-bdc8303c-e4ca-444a-b39d-4219272701f7 req-ae57b69d-e1e4-425f-9fc0-7b625b04836b service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:14.601943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-bdc8303c-e4ca-444a-b39d-4219272701f7 req-ae57b69d-e1e4-425f-9fc0-7b625b04836b service nova] Creating event network-vif-plugged:1bd5c04d-326a-446b-b57a-525d40d706b9 for instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 on hv-cinder-83538 Aug 24 08:59:14.607867 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-bdc8303c-e4ca-444a-b39d-4219272701f7 req-ae57b69d-e1e4-425f-9fc0-7b625b04836b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033706 Aug 24 08:59:14.608627 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 255/510] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:59:14.690881 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3ce5afb4-195c-48fd-b60a-60b816dc073f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:14.698870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3ce5afb4-195c-48fd-b60a-60b816dc073f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1370 microversion: 2.1 time: 0.180240 Aug 24 08:59:14.699535 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 256/511] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:14 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:15.721929 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d08c9fd2-7255-41a8-af52-3cff35ccc28a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:15.722668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d08c9fd2-7255-41a8-af52-3cff35ccc28a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:15.729028 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d08c9fd2-7255-41a8-af52-3cff35ccc28a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:15.729508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d08c9fd2-7255-41a8-af52-3cff35ccc28a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:15.730116 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d08c9fd2-7255-41a8-af52-3cff35ccc28a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:15.730820 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d08c9fd2-7255-41a8-af52-3cff35ccc28a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:15.731283 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d08c9fd2-7255-41a8-af52-3cff35ccc28a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:15.731708 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d08c9fd2-7255-41a8-af52-3cff35ccc28a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:15.865157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d08c9fd2-7255-41a8-af52-3cff35ccc28a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:15.873362 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d08c9fd2-7255-41a8-af52-3cff35ccc28a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1370 microversion: 2.1 time: 0.156208 Aug 24 08:59:15.873929 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 256/512] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:15 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:16.894512 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5cff302c-1570-4c9c-a468-67b3be119b50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:16.895117 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5cff302c-1570-4c9c-a468-67b3be119b50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:16.901353 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cff302c-1570-4c9c-a468-67b3be119b50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:16.901841 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cff302c-1570-4c9c-a468-67b3be119b50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:16.902276 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cff302c-1570-4c9c-a468-67b3be119b50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:16.903973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cff302c-1570-4c9c-a468-67b3be119b50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:16.904540 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cff302c-1570-4c9c-a468-67b3be119b50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:16.904993 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cff302c-1570-4c9c-a468-67b3be119b50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:17.061458 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5cff302c-1570-4c9c-a468-67b3be119b50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:17.070097 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5cff302c-1570-4c9c-a468-67b3be119b50 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1370 microversion: 2.1 time: 0.179497 Aug 24 08:59:17.070574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 257/513] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:16 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:18.091577 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a02e6510-f6f3-412f-b8a8-cf7f1dd1cc27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:18.092243 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a02e6510-f6f3-412f-b8a8-cf7f1dd1cc27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:18.099143 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a02e6510-f6f3-412f-b8a8-cf7f1dd1cc27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:18.099644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a02e6510-f6f3-412f-b8a8-cf7f1dd1cc27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:18.100114 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a02e6510-f6f3-412f-b8a8-cf7f1dd1cc27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:18.100830 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a02e6510-f6f3-412f-b8a8-cf7f1dd1cc27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:18.101302 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a02e6510-f6f3-412f-b8a8-cf7f1dd1cc27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:18.101737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a02e6510-f6f3-412f-b8a8-cf7f1dd1cc27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:18.242603 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a02e6510-f6f3-412f-b8a8-cf7f1dd1cc27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:18.251142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a02e6510-f6f3-412f-b8a8-cf7f1dd1cc27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1563 microversion: 2.1 time: 0.164146 Aug 24 08:59:18.251714 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 257/514] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:18 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:18.271741 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cab6887a-2147-4665-8e6d-4f66486c1628 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:18.272309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cab6887a-2147-4665-8e6d-4f66486c1628 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:18.278220 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab6887a-2147-4665-8e6d-4f66486c1628 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:18.278702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab6887a-2147-4665-8e6d-4f66486c1628 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:18.279143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab6887a-2147-4665-8e6d-4f66486c1628 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:18.279833 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab6887a-2147-4665-8e6d-4f66486c1628 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:18.280324 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab6887a-2147-4665-8e6d-4f66486c1628 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:18.280755 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cab6887a-2147-4665-8e6d-4f66486c1628 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:18.361467 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cab6887a-2147-4665-8e6d-4f66486c1628 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093620 Aug 24 08:59:18.362062 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 258/515] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 24 08:59:18 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:59:19.388770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-607ef962-caf2-4fd3-a42f-cd60cfc92581 req-11bbade4-f5b8-4068-989a-e3a22cf7e6ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e46c8263-fe1c-4e13-92a9-038085ee9ed8", "tag": "1bd5c04d-326a-446b-b57a-525d40d706b9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:19.399939 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-607ef962-caf2-4fd3-a42f-cd60cfc92581 req-11bbade4-f5b8-4068-989a-e3a22cf7e6ae service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:19.400870 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-607ef962-caf2-4fd3-a42f-cd60cfc92581 req-11bbade4-f5b8-4068-989a-e3a22cf7e6ae service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:19.401378 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-607ef962-caf2-4fd3-a42f-cd60cfc92581 req-11bbade4-f5b8-4068-989a-e3a22cf7e6ae service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:19.413716 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-607ef962-caf2-4fd3-a42f-cd60cfc92581 req-11bbade4-f5b8-4068-989a-e3a22cf7e6ae service nova] Creating event network-changed:1bd5c04d-326a-446b-b57a-525d40d706b9 for instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 on hv-cinder-83538 Aug 24 08:59:19.420302 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-607ef962-caf2-4fd3-a42f-cd60cfc92581 req-11bbade4-f5b8-4068-989a-e3a22cf7e6ae service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036003 Aug 24 08:59:19.421877 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 258/516] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 08:59:32.683480 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=11 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:32.686255 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=49 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:32.694623 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-826512ce-b3bb-4d54-a3a9-00ce0f2403b5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:32.695329 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-826512ce-b3bb-4d54-a3a9-00ce0f2403b5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:32.707381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-826512ce-b3bb-4d54-a3a9-00ce0f2403b5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:32.708080 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-826512ce-b3bb-4d54-a3a9-00ce0f2403b5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:32.708880 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-826512ce-b3bb-4d54-a3a9-00ce0f2403b5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:32.709524 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-826512ce-b3bb-4d54-a3a9-00ce0f2403b5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:32.709993 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-826512ce-b3bb-4d54-a3a9-00ce0f2403b5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:32.710993 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-826512ce-b3bb-4d54-a3a9-00ce0f2403b5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:32.738744 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-826512ce-b3bb-4d54-a3a9-00ce0f2403b5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/ips" status: 200 len: 147 microversion: 2.1 time: 0.056056 Aug 24 08:59:32.739383 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 259/517] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 24 08:59:32 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/ips => generated 147 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:59:37.388772 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=15 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:37.390536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=52 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:37.394509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b0614365-81dc-40d2-be45-d68c8b4d7d42 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1324846-eb4b-441b-8bd1-e5dd960979f2"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:37.396933 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b0614365-81dc-40d2-be45-d68c8b4d7d42 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:37.403799 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0614365-81dc-40d2-be45-d68c8b4d7d42 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:37.404316 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0614365-81dc-40d2-be45-d68c8b4d7d42 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:37.404783 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0614365-81dc-40d2-be45-d68c8b4d7d42 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:37.405465 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0614365-81dc-40d2-be45-d68c8b4d7d42 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:37.405913 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0614365-81dc-40d2-be45-d68c8b4d7d42 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:37.406334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0614365-81dc-40d2-be45-d68c8b4d7d42 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:37.677897 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b0614365-81dc-40d2-be45-d68c8b4d7d42 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "POST /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290591 Aug 24 08:59:37.678553 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 259/518] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 24 08:59:37 2022] POST /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:59:39.050510 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ff1e38f4-5863-41c3-bd65-2d44b98d867f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:39.051052 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ff1e38f4-5863-41c3-bd65-2d44b98d867f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:39.057469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff1e38f4-5863-41c3-bd65-2d44b98d867f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:39.057974 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff1e38f4-5863-41c3-bd65-2d44b98d867f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:39.058415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff1e38f4-5863-41c3-bd65-2d44b98d867f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:39.059148 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff1e38f4-5863-41c3-bd65-2d44b98d867f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:39.059610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff1e38f4-5863-41c3-bd65-2d44b98d867f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:39.060038 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff1e38f4-5863-41c3-bd65-2d44b98d867f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:39.083604 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ff1e38f4-5863-41c3-bd65-2d44b98d867f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/ips" status: 200 len: 150 microversion: 2.20 time: 0.037972 Aug 24 08:59:39.086848 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 260/519] 10.222.0.67 () {60 vars in 1289 bytes} [Wed Aug 24 08:59:39 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 08:59:43.206996 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-805c216a-041e-4172-82e2-dce8b39825e9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:43.207653 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-805c216a-041e-4172-82e2-dce8b39825e9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:43.214712 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-805c216a-041e-4172-82e2-dce8b39825e9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:43.215235 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-805c216a-041e-4172-82e2-dce8b39825e9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:43.215686 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-805c216a-041e-4172-82e2-dce8b39825e9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:43.216449 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-805c216a-041e-4172-82e2-dce8b39825e9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:43.217065 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-805c216a-041e-4172-82e2-dce8b39825e9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:43.217902 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-805c216a-041e-4172-82e2-dce8b39825e9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:43.245056 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-805c216a-041e-4172-82e2-dce8b39825e9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lazy-loading 'flavor' on Instance uuid 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 08:59:43.441972 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-805c216a-041e-4172-82e2-dce8b39825e9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "POST /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/action" status: 202 len: 0 microversion: 2.20 time: 0.239866 Aug 24 08:59:43.442765 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 260/520] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 24 08:59:43 2022] POST /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 08:59:43.450903 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-74c502e3-17fa-4d8f-8a87-6da44c87a4c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:43.452219 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-74c502e3-17fa-4d8f-8a87-6da44c87a4c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:43.458760 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74c502e3-17fa-4d8f-8a87-6da44c87a4c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:43.459156 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74c502e3-17fa-4d8f-8a87-6da44c87a4c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:43.459596 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74c502e3-17fa-4d8f-8a87-6da44c87a4c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:43.460342 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74c502e3-17fa-4d8f-8a87-6da44c87a4c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:43.460926 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74c502e3-17fa-4d8f-8a87-6da44c87a4c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:43.461420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-74c502e3-17fa-4d8f-8a87-6da44c87a4c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:43.613923 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-74c502e3-17fa-4d8f-8a87-6da44c87a4c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:43.627585 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-74c502e3-17fa-4d8f-8a87-6da44c87a4c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:43.629246 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-74c502e3-17fa-4d8f-8a87-6da44c87a4c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:43.630720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-74c502e3-17fa-4d8f-8a87-6da44c87a4c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.183752 Aug 24 08:59:43.640568 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 261/521] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:43 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:59:43.668929 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1007285726", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1984818663", "security_groups": [{"name": "tempest-secgroup-smoke-1880210330"}], "block_device_mapping_v2": [{"uuid": "61c8fb8f-12ef-4d06-8999-34980ac06af8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8db512de-7d14-42f9-8a8f-b89724242fee"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:43.790883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] validate_networks() for [('8db512de-7d14-42f9-8a8f-b89724242fee', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 08:59:44.187140 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 08:59:44.187640 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 08:59:44.188040 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 08:59:44.188471 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 08:59:44.188876 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 08:59:44.198402 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:44.198877 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:44.199301 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:44.200021 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:44.200495 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:44.200915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:44.219771 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Getting quotas for project 080318594f144fa3852577bc02ee5357. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 08:59:44.223998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Getting quotas for user 46b3aa99a5e84ef2a8df193628feb0d6 and project 080318594f144fa3852577bc02ee5357. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 08:59:44.284498 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 08:59:44.287062 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61c8fb8f-12ef-4d06-8999-34980ac06af8',volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 08:59:44.460894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1c1dbdef-317d-47be-a4b4-187bce447c31 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.797021 Aug 24 08:59:44.461545 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 261/522] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 08:59:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 08:59:44.472543 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-46c7edb6-25e0-474a-8316-b8713bc5d9ed tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:44.473188 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-46c7edb6-25e0-474a-8316-b8713bc5d9ed tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:44.536761 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-46c7edb6-25e0-474a-8316-b8713bc5d9ed tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:44.544006 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-46c7edb6-25e0-474a-8316-b8713bc5d9ed tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1095 microversion: 2.1 time: 0.075501 Aug 24 08:59:44.544622 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 262/523] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:44 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:44.654750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8923d541-f5d4-404c-b187-afa9a8e10297 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:44.656156 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8923d541-f5d4-404c-b187-afa9a8e10297 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:44.663747 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8923d541-f5d4-404c-b187-afa9a8e10297 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:44.664374 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8923d541-f5d4-404c-b187-afa9a8e10297 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:44.664812 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8923d541-f5d4-404c-b187-afa9a8e10297 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:44.665524 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8923d541-f5d4-404c-b187-afa9a8e10297 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:44.666009 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8923d541-f5d4-404c-b187-afa9a8e10297 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:44.666436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8923d541-f5d4-404c-b187-afa9a8e10297 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:44.823559 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8923d541-f5d4-404c-b187-afa9a8e10297 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:44.833143 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8923d541-f5d4-404c-b187-afa9a8e10297 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:44.835717 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8923d541-f5d4-404c-b187-afa9a8e10297 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:44.836961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8923d541-f5d4-404c-b187-afa9a8e10297 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.186204 Aug 24 08:59:44.838103 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 262/524] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:44 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:59:45.237987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-043f8ab9-4417-4ad4-9698-c9364d963e8b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:45.245377 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-043f8ab9-4417-4ad4-9698-c9364d963e8b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:45.245870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-043f8ab9-4417-4ad4-9698-c9364d963e8b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:45.246311 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-043f8ab9-4417-4ad4-9698-c9364d963e8b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:45.314128 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-043f8ab9-4417-4ad4-9698-c9364d963e8b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Going to try to stop instance {{(pid=120542) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 08:59:45.373575 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-043f8ab9-4417-4ad4-9698-c9364d963e8b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "POST /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/action" status: 202 len: 0 microversion: 2.1 time: 0.139380 Aug 24 08:59:45.374251 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 263/525] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 24 08:59:45 2022] POST /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 08:59:45.383272 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e573b11c-7116-4b9f-9d82-e31c1d30e5fc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:45.383886 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e573b11c-7116-4b9f-9d82-e31c1d30e5fc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:45.391152 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e573b11c-7116-4b9f-9d82-e31c1d30e5fc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:45.391649 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e573b11c-7116-4b9f-9d82-e31c1d30e5fc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:45.392109 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e573b11c-7116-4b9f-9d82-e31c1d30e5fc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:45.392839 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e573b11c-7116-4b9f-9d82-e31c1d30e5fc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:45.393316 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e573b11c-7116-4b9f-9d82-e31c1d30e5fc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:45.393719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e573b11c-7116-4b9f-9d82-e31c1d30e5fc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:45.562959 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e573b11c-7116-4b9f-9d82-e31c1d30e5fc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:45.569201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-75f89561-6524-480b-a13a-9d9da4d281c9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:45.569853 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-75f89561-6524-480b-a13a-9d9da4d281c9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:45.573917 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e573b11c-7116-4b9f-9d82-e31c1d30e5fc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1725 microversion: 2.1 time: 0.194956 Aug 24 08:59:45.575136 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 263/526] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:45 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:45.580788 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75f89561-6524-480b-a13a-9d9da4d281c9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:45.581775 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75f89561-6524-480b-a13a-9d9da4d281c9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:45.582863 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75f89561-6524-480b-a13a-9d9da4d281c9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:45.584279 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75f89561-6524-480b-a13a-9d9da4d281c9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:45.585410 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75f89561-6524-480b-a13a-9d9da4d281c9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:45.586282 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75f89561-6524-480b-a13a-9d9da4d281c9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:45.673660 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-75f89561-6524-480b-a13a-9d9da4d281c9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:45.682321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-75f89561-6524-480b-a13a-9d9da4d281c9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1193 microversion: 2.1 time: 0.118429 Aug 24 08:59:45.683911 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 264/527] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:45 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1193 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:59:45.862332 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-db1f8804-5a6d-4155-a34a-2a34b3e3c216 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:45.862956 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-db1f8804-5a6d-4155-a34a-2a34b3e3c216 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:45.869514 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db1f8804-5a6d-4155-a34a-2a34b3e3c216 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:45.870091 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db1f8804-5a6d-4155-a34a-2a34b3e3c216 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:45.870532 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db1f8804-5a6d-4155-a34a-2a34b3e3c216 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:45.871304 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db1f8804-5a6d-4155-a34a-2a34b3e3c216 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:45.871764 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db1f8804-5a6d-4155-a34a-2a34b3e3c216 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:45.872224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-db1f8804-5a6d-4155-a34a-2a34b3e3c216 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:46.147362 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-db1f8804-5a6d-4155-a34a-2a34b3e3c216 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:46.159669 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-db1f8804-5a6d-4155-a34a-2a34b3e3c216 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:46.162113 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-db1f8804-5a6d-4155-a34a-2a34b3e3c216 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:46.164290 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-db1f8804-5a6d-4155-a34a-2a34b3e3c216 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.307171 Aug 24 08:59:46.165282 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 264/528] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:45 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:59:46.597720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aa6c5e6a-5f6a-4fdc-a534-fd8b82e82465 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:46.598571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aa6c5e6a-5f6a-4fdc-a534-fd8b82e82465 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:46.604953 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa6c5e6a-5f6a-4fdc-a534-fd8b82e82465 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:46.607148 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa6c5e6a-5f6a-4fdc-a534-fd8b82e82465 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:46.607658 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa6c5e6a-5f6a-4fdc-a534-fd8b82e82465 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:46.609772 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa6c5e6a-5f6a-4fdc-a534-fd8b82e82465 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:46.611089 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa6c5e6a-5f6a-4fdc-a534-fd8b82e82465 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:46.611693 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aa6c5e6a-5f6a-4fdc-a534-fd8b82e82465 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:46.716019 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c4d7ea09-11d3-483b-986b-2587b6b2627d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:46.717083 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c4d7ea09-11d3-483b-986b-2587b6b2627d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:46.728660 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4d7ea09-11d3-483b-986b-2587b6b2627d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:46.729784 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4d7ea09-11d3-483b-986b-2587b6b2627d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:46.730694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4d7ea09-11d3-483b-986b-2587b6b2627d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:46.731867 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4d7ea09-11d3-483b-986b-2587b6b2627d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:46.732542 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4d7ea09-11d3-483b-986b-2587b6b2627d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:46.733473 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4d7ea09-11d3-483b-986b-2587b6b2627d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:47.219733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-aa6c5e6a-5f6a-4fdc-a534-fd8b82e82465 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:47.229061 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aa6c5e6a-5f6a-4fdc-a534-fd8b82e82465 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1725 microversion: 2.1 time: 0.636289 Aug 24 08:59:47.229740 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 265/529] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:46 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1725 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:47.236446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c44009ef-9a9c-4ab3-ab69-f7825261430f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:47.237415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c44009ef-9a9c-4ab3-ab69-f7825261430f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:47.244977 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c44009ef-9a9c-4ab3-ab69-f7825261430f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:47.245673 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c44009ef-9a9c-4ab3-ab69-f7825261430f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:47.246102 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c44009ef-9a9c-4ab3-ab69-f7825261430f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:47.246801 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c44009ef-9a9c-4ab3-ab69-f7825261430f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:47.247299 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c44009ef-9a9c-4ab3-ab69-f7825261430f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:47.247672 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c44009ef-9a9c-4ab3-ab69-f7825261430f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:47.415650 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4d7ea09-11d3-483b-986b-2587b6b2627d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:47.426246 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c4d7ea09-11d3-483b-986b-2587b6b2627d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1279 microversion: 2.1 time: 0.725489 Aug 24 08:59:47.427067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 265/530] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:46 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1279 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:59:47.536016 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c44009ef-9a9c-4ab3-ab69-f7825261430f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:47.545108 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c44009ef-9a9c-4ab3-ab69-f7825261430f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:47.546784 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c44009ef-9a9c-4ab3-ab69-f7825261430f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:47.547955 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c44009ef-9a9c-4ab3-ab69-f7825261430f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.317057 Aug 24 08:59:47.549106 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 266/531] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:47 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:59:48.068990 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-539d07ff-7924-4d65-baeb-84330835b699 req-d6e91867-d314-47b8-8aa2-cdf318ee5be0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dff703e-fd9a-4783-9b0d-98337571e993", "tag": "7996caca-db82-4075-943a-f06676d4fa8c"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 08:59:48.083146 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-539d07ff-7924-4d65-baeb-84330835b699 req-d6e91867-d314-47b8-8aa2-cdf318ee5be0 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:48.083978 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-539d07ff-7924-4d65-baeb-84330835b699 req-d6e91867-d314-47b8-8aa2-cdf318ee5be0 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:48.084814 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-539d07ff-7924-4d65-baeb-84330835b699 req-d6e91867-d314-47b8-8aa2-cdf318ee5be0 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:48.107124 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-539d07ff-7924-4d65-baeb-84330835b699 req-d6e91867-d314-47b8-8aa2-cdf318ee5be0 service nova] Creating event network-changed:7996caca-db82-4075-943a-f06676d4fa8c for instance 2dff703e-fd9a-4783-9b0d-98337571e993 on hv-cinder-83538 Aug 24 08:59:48.113218 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-539d07ff-7924-4d65-baeb-84330835b699 req-d6e91867-d314-47b8-8aa2-cdf318ee5be0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050367 Aug 24 08:59:48.114434 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 266/532] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 08:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 08:59:48.251323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-714d149c-f5a1-4191-80db-e3dc336218d6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:48.252006 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-714d149c-f5a1-4191-80db-e3dc336218d6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:48.258453 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-714d149c-f5a1-4191-80db-e3dc336218d6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:48.259020 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-714d149c-f5a1-4191-80db-e3dc336218d6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:48.259525 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-714d149c-f5a1-4191-80db-e3dc336218d6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:48.260330 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-714d149c-f5a1-4191-80db-e3dc336218d6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:48.260791 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-714d149c-f5a1-4191-80db-e3dc336218d6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:48.261220 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-714d149c-f5a1-4191-80db-e3dc336218d6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:48.449670 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-535dcea1-1366-4c81-8dae-e66ca6b34692 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:48.450638 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-535dcea1-1366-4c81-8dae-e66ca6b34692 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:48.456891 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-535dcea1-1366-4c81-8dae-e66ca6b34692 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:48.457461 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-535dcea1-1366-4c81-8dae-e66ca6b34692 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:48.457899 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-535dcea1-1366-4c81-8dae-e66ca6b34692 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:48.458591 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-535dcea1-1366-4c81-8dae-e66ca6b34692 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:48.459047 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-535dcea1-1366-4c81-8dae-e66ca6b34692 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:48.459470 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-535dcea1-1366-4c81-8dae-e66ca6b34692 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:48.485311 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-714d149c-f5a1-4191-80db-e3dc336218d6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:48.493964 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-714d149c-f5a1-4191-80db-e3dc336218d6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1725 microversion: 2.1 time: 0.246968 Aug 24 08:59:48.494555 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 267/533] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:48 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1725 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:48.571885 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fbffd1b1-c123-497b-84ed-34a14a9e1301 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:48.572640 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fbffd1b1-c123-497b-84ed-34a14a9e1301 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:48.579101 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbffd1b1-c123-497b-84ed-34a14a9e1301 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:48.579597 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbffd1b1-c123-497b-84ed-34a14a9e1301 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:48.580039 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbffd1b1-c123-497b-84ed-34a14a9e1301 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:48.580775 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbffd1b1-c123-497b-84ed-34a14a9e1301 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:48.581233 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbffd1b1-c123-497b-84ed-34a14a9e1301 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:48.581660 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fbffd1b1-c123-497b-84ed-34a14a9e1301 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:48.735251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-535dcea1-1366-4c81-8dae-e66ca6b34692 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:48.749486 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-535dcea1-1366-4c81-8dae-e66ca6b34692 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1267 microversion: 2.1 time: 0.304040 Aug 24 08:59:48.750155 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 267/534] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:48 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 08:59:48.812035 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-fbffd1b1-c123-497b-84ed-34a14a9e1301 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:48.820619 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-fbffd1b1-c123-497b-84ed-34a14a9e1301 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:48.822144 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-fbffd1b1-c123-497b-84ed-34a14a9e1301 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:48.823339 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fbffd1b1-c123-497b-84ed-34a14a9e1301 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.255354 Aug 24 08:59:48.823923 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 268/535] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:48 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:59:49.517540 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3ae89559-852f-405f-a6a1-43401e517ed7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:49.518164 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3ae89559-852f-405f-a6a1-43401e517ed7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:49.524591 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ae89559-852f-405f-a6a1-43401e517ed7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:49.525074 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ae89559-852f-405f-a6a1-43401e517ed7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:49.525504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ae89559-852f-405f-a6a1-43401e517ed7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:49.526186 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ae89559-852f-405f-a6a1-43401e517ed7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:49.526639 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ae89559-852f-405f-a6a1-43401e517ed7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:49.527055 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ae89559-852f-405f-a6a1-43401e517ed7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:49.657729 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3ae89559-852f-405f-a6a1-43401e517ed7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:49.665866 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3ae89559-852f-405f-a6a1-43401e517ed7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1725 microversion: 2.1 time: 0.152935 Aug 24 08:59:49.666419 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 268/536] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:49 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:49.781226 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b2be02f5-f0bc-4e45-b9c0-20cb3dda2d88 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:49.781911 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b2be02f5-f0bc-4e45-b9c0-20cb3dda2d88 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:49.787974 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2be02f5-f0bc-4e45-b9c0-20cb3dda2d88 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:49.788548 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2be02f5-f0bc-4e45-b9c0-20cb3dda2d88 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:49.789043 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2be02f5-f0bc-4e45-b9c0-20cb3dda2d88 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:49.789796 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2be02f5-f0bc-4e45-b9c0-20cb3dda2d88 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:49.790336 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2be02f5-f0bc-4e45-b9c0-20cb3dda2d88 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:49.790838 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b2be02f5-f0bc-4e45-b9c0-20cb3dda2d88 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:49.846712 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e81f3186-70c1-44f7-98a3-238e1c5e296b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:49.847309 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e81f3186-70c1-44f7-98a3-238e1c5e296b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:49.853434 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e81f3186-70c1-44f7-98a3-238e1c5e296b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:49.853919 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e81f3186-70c1-44f7-98a3-238e1c5e296b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:49.854345 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e81f3186-70c1-44f7-98a3-238e1c5e296b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:49.855048 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e81f3186-70c1-44f7-98a3-238e1c5e296b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:49.855490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e81f3186-70c1-44f7-98a3-238e1c5e296b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:49.855909 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e81f3186-70c1-44f7-98a3-238e1c5e296b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:49.975718 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b2be02f5-f0bc-4e45-b9c0-20cb3dda2d88 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:49.984523 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b2be02f5-f0bc-4e45-b9c0-20cb3dda2d88 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1267 microversion: 2.1 time: 0.206645 Aug 24 08:59:49.985101 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 269/537] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:49 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:50.020605 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e81f3186-70c1-44f7-98a3-238e1c5e296b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:50.028712 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e81f3186-70c1-44f7-98a3-238e1c5e296b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:50.030160 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e81f3186-70c1-44f7-98a3-238e1c5e296b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:50.032050 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e81f3186-70c1-44f7-98a3-238e1c5e296b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.189547 Aug 24 08:59:50.032634 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 269/538] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:49 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:59:50.687208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2e848b07-25be-41af-8114-8b1f51d775d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:50.687805 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2e848b07-25be-41af-8114-8b1f51d775d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:50.693744 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e848b07-25be-41af-8114-8b1f51d775d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:50.694229 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e848b07-25be-41af-8114-8b1f51d775d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:50.694663 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e848b07-25be-41af-8114-8b1f51d775d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:50.695344 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e848b07-25be-41af-8114-8b1f51d775d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:50.695793 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e848b07-25be-41af-8114-8b1f51d775d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:50.696256 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e848b07-25be-41af-8114-8b1f51d775d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:50.827652 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2e848b07-25be-41af-8114-8b1f51d775d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:50.843721 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2e848b07-25be-41af-8114-8b1f51d775d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1725 microversion: 2.1 time: 0.159708 Aug 24 08:59:50.844339 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 270/539] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:50 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:51.006562 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5e3ec157-41d6-4010-9c56-b114f4ecafb2 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:51.007139 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5e3ec157-41d6-4010-9c56-b114f4ecafb2 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:51.014386 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e3ec157-41d6-4010-9c56-b114f4ecafb2 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:51.014907 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e3ec157-41d6-4010-9c56-b114f4ecafb2 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:51.015658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e3ec157-41d6-4010-9c56-b114f4ecafb2 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:51.016407 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e3ec157-41d6-4010-9c56-b114f4ecafb2 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:51.016860 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e3ec157-41d6-4010-9c56-b114f4ecafb2 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:51.017310 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5e3ec157-41d6-4010-9c56-b114f4ecafb2 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:51.055896 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3976e889-5f88-4d56-a208-47b3e259a1e0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:51.056558 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3976e889-5f88-4d56-a208-47b3e259a1e0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:51.064005 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3976e889-5f88-4d56-a208-47b3e259a1e0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:51.064532 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3976e889-5f88-4d56-a208-47b3e259a1e0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:51.064973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3976e889-5f88-4d56-a208-47b3e259a1e0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:51.065730 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3976e889-5f88-4d56-a208-47b3e259a1e0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:51.066195 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3976e889-5f88-4d56-a208-47b3e259a1e0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:51.066622 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3976e889-5f88-4d56-a208-47b3e259a1e0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:51.278119 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5e3ec157-41d6-4010-9c56-b114f4ecafb2 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:51.289249 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5e3ec157-41d6-4010-9c56-b114f4ecafb2 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1267 microversion: 2.1 time: 0.287493 Aug 24 08:59:51.291024 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 270/540] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:51 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1267 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:51.348057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3976e889-5f88-4d56-a208-47b3e259a1e0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:51.356372 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3976e889-5f88-4d56-a208-47b3e259a1e0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:51.357885 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3976e889-5f88-4d56-a208-47b3e259a1e0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:51.359944 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3976e889-5f88-4d56-a208-47b3e259a1e0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.308639 Aug 24 08:59:51.360748 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 271/541] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:51 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:59:51.865442 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e55fcf4a-1f95-4b9b-b091-465966abdde4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:51.866050 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e55fcf4a-1f95-4b9b-b091-465966abdde4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:51.872059 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e55fcf4a-1f95-4b9b-b091-465966abdde4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:51.872561 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e55fcf4a-1f95-4b9b-b091-465966abdde4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:51.872993 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e55fcf4a-1f95-4b9b-b091-465966abdde4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:51.873686 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e55fcf4a-1f95-4b9b-b091-465966abdde4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:51.874276 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e55fcf4a-1f95-4b9b-b091-465966abdde4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:51.874759 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e55fcf4a-1f95-4b9b-b091-465966abdde4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:52.004636 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e55fcf4a-1f95-4b9b-b091-465966abdde4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:52.013570 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e55fcf4a-1f95-4b9b-b091-465966abdde4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1725 microversion: 2.1 time: 0.151888 Aug 24 08:59:52.014156 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 271/542] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:51 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:52.310666 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9ef2d85d-2594-42b9-bfa8-9e7f09042735 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:52.311278 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9ef2d85d-2594-42b9-bfa8-9e7f09042735 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:52.317396 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ef2d85d-2594-42b9-bfa8-9e7f09042735 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:52.317887 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ef2d85d-2594-42b9-bfa8-9e7f09042735 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:52.318328 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ef2d85d-2594-42b9-bfa8-9e7f09042735 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:52.319025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ef2d85d-2594-42b9-bfa8-9e7f09042735 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:52.319485 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ef2d85d-2594-42b9-bfa8-9e7f09042735 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:52.319918 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ef2d85d-2594-42b9-bfa8-9e7f09042735 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:52.384577 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-386aea3a-48b9-459b-bc9c-310ae503b118 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:52.385200 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-386aea3a-48b9-459b-bc9c-310ae503b118 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:52.391459 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-386aea3a-48b9-459b-bc9c-310ae503b118 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:52.391952 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-386aea3a-48b9-459b-bc9c-310ae503b118 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:52.392419 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-386aea3a-48b9-459b-bc9c-310ae503b118 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:52.393124 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-386aea3a-48b9-459b-bc9c-310ae503b118 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:52.393601 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-386aea3a-48b9-459b-bc9c-310ae503b118 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:52.394045 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-386aea3a-48b9-459b-bc9c-310ae503b118 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:52.487252 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9ef2d85d-2594-42b9-bfa8-9e7f09042735 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:52.495037 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9ef2d85d-2594-42b9-bfa8-9e7f09042735 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1267 microversion: 2.1 time: 0.188205 Aug 24 08:59:52.495756 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 272/543] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:52 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:52.548162 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-386aea3a-48b9-459b-bc9c-310ae503b118 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:52.556281 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-386aea3a-48b9-459b-bc9c-310ae503b118 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:52.557801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-386aea3a-48b9-459b-bc9c-310ae503b118 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:52.558948 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-386aea3a-48b9-459b-bc9c-310ae503b118 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.178638 Aug 24 08:59:52.559496 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 272/544] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:52 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 08:59:53.035707 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ce139473-6ca2-4a34-a329-cd0fcb2dd0c9 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:53.036247 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ce139473-6ca2-4a34-a329-cd0fcb2dd0c9 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:53.042217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce139473-6ca2-4a34-a329-cd0fcb2dd0c9 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:53.042693 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce139473-6ca2-4a34-a329-cd0fcb2dd0c9 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:53.043125 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce139473-6ca2-4a34-a329-cd0fcb2dd0c9 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:53.043813 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce139473-6ca2-4a34-a329-cd0fcb2dd0c9 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:53.044297 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce139473-6ca2-4a34-a329-cd0fcb2dd0c9 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:53.044717 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ce139473-6ca2-4a34-a329-cd0fcb2dd0c9 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:53.188963 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ce139473-6ca2-4a34-a329-cd0fcb2dd0c9 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:53.197680 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ce139473-6ca2-4a34-a329-cd0fcb2dd0c9 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1725 microversion: 2.1 time: 0.165811 Aug 24 08:59:53.198267 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 273/545] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:53 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:53.516881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f379f632-5097-4cc9-8c99-e4c4297337c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:53.517485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f379f632-5097-4cc9-8c99-e4c4297337c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:53.523942 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f379f632-5097-4cc9-8c99-e4c4297337c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:53.524464 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f379f632-5097-4cc9-8c99-e4c4297337c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:53.524893 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f379f632-5097-4cc9-8c99-e4c4297337c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:53.525576 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f379f632-5097-4cc9-8c99-e4c4297337c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:53.526023 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f379f632-5097-4cc9-8c99-e4c4297337c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:53.526440 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f379f632-5097-4cc9-8c99-e4c4297337c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:53.545074 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:53.582127 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-568c9ba4-a5e6-4ffe-94e3-415af122e2e7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:53.582736 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-568c9ba4-a5e6-4ffe-94e3-415af122e2e7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:53.588800 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-568c9ba4-a5e6-4ffe-94e3-415af122e2e7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:53.589275 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-568c9ba4-a5e6-4ffe-94e3-415af122e2e7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:53.589719 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-568c9ba4-a5e6-4ffe-94e3-415af122e2e7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:53.590421 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-568c9ba4-a5e6-4ffe-94e3-415af122e2e7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:53.590878 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-568c9ba4-a5e6-4ffe-94e3-415af122e2e7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:53.591304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-568c9ba4-a5e6-4ffe-94e3-415af122e2e7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:53.693778 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f379f632-5097-4cc9-8c99-e4c4297337c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:53.701710 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f379f632-5097-4cc9-8c99-e4c4297337c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1267 microversion: 2.1 time: 0.189402 Aug 24 08:59:53.702791 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 273/546] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:53 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:53.754444 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-568c9ba4-a5e6-4ffe-94e3-415af122e2e7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:53.762747 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-568c9ba4-a5e6-4ffe-94e3-415af122e2e7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:53.764305 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-568c9ba4-a5e6-4ffe-94e3-415af122e2e7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:53.766060 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-568c9ba4-a5e6-4ffe-94e3-415af122e2e7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.188500 Aug 24 08:59:53.766616 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 274/547] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:53 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:59:54.220969 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-24c16d41-19f2-49dc-8dc2-8764e46bf80c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:54.221490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-24c16d41-19f2-49dc-8dc2-8764e46bf80c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:54.223340 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:54.228558 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24c16d41-19f2-49dc-8dc2-8764e46bf80c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:54.229037 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24c16d41-19f2-49dc-8dc2-8764e46bf80c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:54.229473 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24c16d41-19f2-49dc-8dc2-8764e46bf80c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:54.230153 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24c16d41-19f2-49dc-8dc2-8764e46bf80c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:54.230603 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24c16d41-19f2-49dc-8dc2-8764e46bf80c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:54.231021 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24c16d41-19f2-49dc-8dc2-8764e46bf80c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:54.231600 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:54.366726 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-24c16d41-19f2-49dc-8dc2-8764e46bf80c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:54.377037 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-24c16d41-19f2-49dc-8dc2-8764e46bf80c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1725 microversion: 2.1 time: 0.160666 Aug 24 08:59:54.377636 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 274/548] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:54 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:54.722835 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7f8f1d69-ce76-4051-8d8b-e77ab8beab8b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:54.724077 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7f8f1d69-ce76-4051-8d8b-e77ab8beab8b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:54.727887 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:54.732405 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f8f1d69-ce76-4051-8d8b-e77ab8beab8b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:54.732910 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f8f1d69-ce76-4051-8d8b-e77ab8beab8b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:54.733356 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f8f1d69-ce76-4051-8d8b-e77ab8beab8b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:54.734483 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f8f1d69-ce76-4051-8d8b-e77ab8beab8b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:54.735176 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f8f1d69-ce76-4051-8d8b-e77ab8beab8b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:54.735624 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7f8f1d69-ce76-4051-8d8b-e77ab8beab8b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:54.788554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-699f9b52-c72f-47b4-a3d6-9f406b1c1239 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:54.789163 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-699f9b52-c72f-47b4-a3d6-9f406b1c1239 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:54.795700 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-699f9b52-c72f-47b4-a3d6-9f406b1c1239 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:54.796275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-699f9b52-c72f-47b4-a3d6-9f406b1c1239 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:54.796984 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-699f9b52-c72f-47b4-a3d6-9f406b1c1239 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:54.797822 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-699f9b52-c72f-47b4-a3d6-9f406b1c1239 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:54.798277 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-699f9b52-c72f-47b4-a3d6-9f406b1c1239 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:54.798699 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-699f9b52-c72f-47b4-a3d6-9f406b1c1239 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:54.927618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7f8f1d69-ce76-4051-8d8b-e77ab8beab8b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:54.935363 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7f8f1d69-ce76-4051-8d8b-e77ab8beab8b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1267 microversion: 2.1 time: 0.216573 Aug 24 08:59:54.935932 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 275/549] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:54 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:54.964483 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-699f9b52-c72f-47b4-a3d6-9f406b1c1239 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:54.973401 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-699f9b52-c72f-47b4-a3d6-9f406b1c1239 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:54.974926 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-699f9b52-c72f-47b4-a3d6-9f406b1c1239 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:54.976107 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-699f9b52-c72f-47b4-a3d6-9f406b1c1239 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.191580 Aug 24 08:59:54.976684 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 275/550] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:54 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:59:55.399127 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1cfb0f72-128a-4fd9-a7bf-ce5bd9a36b2e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:55.399735 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1cfb0f72-128a-4fd9-a7bf-ce5bd9a36b2e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:55.406263 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cfb0f72-128a-4fd9-a7bf-ce5bd9a36b2e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:55.406750 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cfb0f72-128a-4fd9-a7bf-ce5bd9a36b2e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:55.407285 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cfb0f72-128a-4fd9-a7bf-ce5bd9a36b2e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:55.407990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cfb0f72-128a-4fd9-a7bf-ce5bd9a36b2e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:55.408477 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cfb0f72-128a-4fd9-a7bf-ce5bd9a36b2e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:55.408964 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1cfb0f72-128a-4fd9-a7bf-ce5bd9a36b2e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:55.413245 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:55.547770 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1cfb0f72-128a-4fd9-a7bf-ce5bd9a36b2e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:55.556121 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1cfb0f72-128a-4fd9-a7bf-ce5bd9a36b2e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1725 microversion: 2.1 time: 0.160791 Aug 24 08:59:55.556696 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 276/551] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:55 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:55.956142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-11eb4203-5503-496b-9b77-a3a405a6e278 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:55.956768 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-11eb4203-5503-496b-9b77-a3a405a6e278 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:55.963310 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11eb4203-5503-496b-9b77-a3a405a6e278 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:55.963792 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11eb4203-5503-496b-9b77-a3a405a6e278 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:55.964267 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11eb4203-5503-496b-9b77-a3a405a6e278 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:55.964973 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11eb4203-5503-496b-9b77-a3a405a6e278 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:55.965455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11eb4203-5503-496b-9b77-a3a405a6e278 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:55.965900 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11eb4203-5503-496b-9b77-a3a405a6e278 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:55.998528 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6737dd4a-c320-4d35-8928-8e4d4010e349 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:55.999057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6737dd4a-c320-4d35-8928-8e4d4010e349 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:56.005723 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6737dd4a-c320-4d35-8928-8e4d4010e349 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:56.006576 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6737dd4a-c320-4d35-8928-8e4d4010e349 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:56.007010 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6737dd4a-c320-4d35-8928-8e4d4010e349 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:56.007701 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6737dd4a-c320-4d35-8928-8e4d4010e349 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:56.008786 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6737dd4a-c320-4d35-8928-8e4d4010e349 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:56.009203 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6737dd4a-c320-4d35-8928-8e4d4010e349 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:56.166802 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-11eb4203-5503-496b-9b77-a3a405a6e278 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:56.175521 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-11eb4203-5503-496b-9b77-a3a405a6e278 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1267 microversion: 2.1 time: 0.223810 Aug 24 08:59:56.176088 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 276/552] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:55 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:56.197123 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6737dd4a-c320-4d35-8928-8e4d4010e349 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:56.206243 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6737dd4a-c320-4d35-8928-8e4d4010e349 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:56.207770 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6737dd4a-c320-4d35-8928-8e4d4010e349 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:56.208982 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6737dd4a-c320-4d35-8928-8e4d4010e349 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.214405 Aug 24 08:59:56.209564 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 277/553] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:55 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:59:56.578084 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7cc5ab4a-60b0-4593-a15a-b6e2311ebdcd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:56.578711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7cc5ab4a-60b0-4593-a15a-b6e2311ebdcd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:56.585355 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cc5ab4a-60b0-4593-a15a-b6e2311ebdcd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:56.585857 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cc5ab4a-60b0-4593-a15a-b6e2311ebdcd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:56.586577 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cc5ab4a-60b0-4593-a15a-b6e2311ebdcd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:56.587302 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cc5ab4a-60b0-4593-a15a-b6e2311ebdcd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:56.587760 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cc5ab4a-60b0-4593-a15a-b6e2311ebdcd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:56.588232 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cc5ab4a-60b0-4593-a15a-b6e2311ebdcd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:56.732084 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7cc5ab4a-60b0-4593-a15a-b6e2311ebdcd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:56.741177 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7cc5ab4a-60b0-4593-a15a-b6e2311ebdcd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1725 microversion: 2.1 time: 0.167545 Aug 24 08:59:56.741752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 277/554] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:56 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:57.197272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-023b766c-3e07-464a-8cb8-cc1df03c0827 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:57.197887 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-023b766c-3e07-464a-8cb8-cc1df03c0827 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:57.205122 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023b766c-3e07-464a-8cb8-cc1df03c0827 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:57.205617 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023b766c-3e07-464a-8cb8-cc1df03c0827 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:57.206058 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023b766c-3e07-464a-8cb8-cc1df03c0827 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:57.206774 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023b766c-3e07-464a-8cb8-cc1df03c0827 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:57.207236 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023b766c-3e07-464a-8cb8-cc1df03c0827 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:57.207662 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-023b766c-3e07-464a-8cb8-cc1df03c0827 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:57.230931 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4f12c341-513f-448a-b6ac-d1f51d6a4016 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:57.231554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4f12c341-513f-448a-b6ac-d1f51d6a4016 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:57.238801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f12c341-513f-448a-b6ac-d1f51d6a4016 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:57.239294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f12c341-513f-448a-b6ac-d1f51d6a4016 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:57.239737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f12c341-513f-448a-b6ac-d1f51d6a4016 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:57.240475 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f12c341-513f-448a-b6ac-d1f51d6a4016 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:57.240938 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f12c341-513f-448a-b6ac-d1f51d6a4016 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:57.241367 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4f12c341-513f-448a-b6ac-d1f51d6a4016 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:57.423071 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-023b766c-3e07-464a-8cb8-cc1df03c0827 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:57.430907 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-4f12c341-513f-448a-b6ac-d1f51d6a4016 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:57.431170 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-023b766c-3e07-464a-8cb8-cc1df03c0827 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1267 microversion: 2.1 time: 0.237648 Aug 24 08:59:57.431704 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 278/555] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:57 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:57.440339 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-4f12c341-513f-448a-b6ac-d1f51d6a4016 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:57.441860 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-4f12c341-513f-448a-b6ac-d1f51d6a4016 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:57.443035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4f12c341-513f-448a-b6ac-d1f51d6a4016 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.216061 Aug 24 08:59:57.443579 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 278/556] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:57 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:59:57.762911 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3033fadf-57ca-4fc7-9ea4-43928dd9459a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:57.763516 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3033fadf-57ca-4fc7-9ea4-43928dd9459a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:57.769476 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3033fadf-57ca-4fc7-9ea4-43928dd9459a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:57.769951 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3033fadf-57ca-4fc7-9ea4-43928dd9459a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:57.770382 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3033fadf-57ca-4fc7-9ea4-43928dd9459a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:57.771062 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3033fadf-57ca-4fc7-9ea4-43928dd9459a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:57.771513 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3033fadf-57ca-4fc7-9ea4-43928dd9459a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:57.771937 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3033fadf-57ca-4fc7-9ea4-43928dd9459a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:57.902884 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3033fadf-57ca-4fc7-9ea4-43928dd9459a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:57.912023 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3033fadf-57ca-4fc7-9ea4-43928dd9459a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1725 microversion: 2.1 time: 0.152917 Aug 24 08:59:57.912611 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 279/557] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:57 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:58.452696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e9e367f5-1c7f-4995-bac8-50e20b7ea3ef tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:58.453542 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e9e367f5-1c7f-4995-bac8-50e20b7ea3ef tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:58.460176 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9e367f5-1c7f-4995-bac8-50e20b7ea3ef tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:58.460666 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9e367f5-1c7f-4995-bac8-50e20b7ea3ef tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:58.461157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9e367f5-1c7f-4995-bac8-50e20b7ea3ef tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:58.461806 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9e367f5-1c7f-4995-bac8-50e20b7ea3ef tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:58.462264 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9e367f5-1c7f-4995-bac8-50e20b7ea3ef tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:58.462691 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e9e367f5-1c7f-4995-bac8-50e20b7ea3ef tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:58.466459 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1eb155e1-e548-498a-a9f4-ff89ffa3fd12 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:58.467072 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1eb155e1-e548-498a-a9f4-ff89ffa3fd12 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:58.474006 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1eb155e1-e548-498a-a9f4-ff89ffa3fd12 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:58.474495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1eb155e1-e548-498a-a9f4-ff89ffa3fd12 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:58.475580 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1eb155e1-e548-498a-a9f4-ff89ffa3fd12 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:58.476324 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1eb155e1-e548-498a-a9f4-ff89ffa3fd12 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:58.476792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1eb155e1-e548-498a-a9f4-ff89ffa3fd12 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:58.477221 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1eb155e1-e548-498a-a9f4-ff89ffa3fd12 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:58.665077 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e9e367f5-1c7f-4995-bac8-50e20b7ea3ef tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:58.671974 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1eb155e1-e548-498a-a9f4-ff89ffa3fd12 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:58.680435 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e9e367f5-1c7f-4995-bac8-50e20b7ea3ef tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1267 microversion: 2.1 time: 0.231583 Aug 24 08:59:58.681257 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1eb155e1-e548-498a-a9f4-ff89ffa3fd12 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:58.681391 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 279/558] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:58 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:58.682475 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1eb155e1-e548-498a-a9f4-ff89ffa3fd12 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:58.683679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1eb155e1-e548-498a-a9f4-ff89ffa3fd12 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.221123 Aug 24 08:59:58.684744 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 280/559] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:58 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 08:59:58.932755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cbcc3ffe-9a45-4d36-b7a3-16dd29412809 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:58.933363 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cbcc3ffe-9a45-4d36-b7a3-16dd29412809 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:58.939945 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbcc3ffe-9a45-4d36-b7a3-16dd29412809 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:58.940462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbcc3ffe-9a45-4d36-b7a3-16dd29412809 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:58.940904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbcc3ffe-9a45-4d36-b7a3-16dd29412809 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:58.941605 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbcc3ffe-9a45-4d36-b7a3-16dd29412809 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:58.942061 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbcc3ffe-9a45-4d36-b7a3-16dd29412809 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:58.942492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbcc3ffe-9a45-4d36-b7a3-16dd29412809 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:59.073712 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-cbcc3ffe-9a45-4d36-b7a3-16dd29412809 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:59.082188 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cbcc3ffe-9a45-4d36-b7a3-16dd29412809 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1725 microversion: 2.1 time: 0.153334 Aug 24 08:59:59.082757 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 280/560] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:58 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:59.700501 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3522d0ef-c744-4b99-ac75-4e9342c565bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:59.701118 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3522d0ef-c744-4b99-ac75-4e9342c565bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:59.706521 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a85803c7-7e50-4743-9987-882aecc991b7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 08:59:59.707138 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a85803c7-7e50-4743-9987-882aecc991b7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 08:59:59.707656 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3522d0ef-c744-4b99-ac75-4e9342c565bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:59.708319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3522d0ef-c744-4b99-ac75-4e9342c565bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:59.708769 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3522d0ef-c744-4b99-ac75-4e9342c565bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:59.709623 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3522d0ef-c744-4b99-ac75-4e9342c565bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:59.710356 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3522d0ef-c744-4b99-ac75-4e9342c565bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:59.710897 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3522d0ef-c744-4b99-ac75-4e9342c565bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:59.713800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a85803c7-7e50-4743-9987-882aecc991b7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:59.714293 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a85803c7-7e50-4743-9987-882aecc991b7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:59.714730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a85803c7-7e50-4743-9987-882aecc991b7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:59.716696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a85803c7-7e50-4743-9987-882aecc991b7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 08:59:59.716696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a85803c7-7e50-4743-9987-882aecc991b7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 08:59:59.716696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a85803c7-7e50-4743-9987-882aecc991b7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 08:59:59.912870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3522d0ef-c744-4b99-ac75-4e9342c565bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:59.916290 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a85803c7-7e50-4743-9987-882aecc991b7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:59.920693 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3522d0ef-c744-4b99-ac75-4e9342c565bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1267 microversion: 2.1 time: 0.223986 Aug 24 08:59:59.921273 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 281/561] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 08:59:59 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 08:59:59.925737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a85803c7-7e50-4743-9987-882aecc991b7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:59.927352 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a85803c7-7e50-4743-9987-882aecc991b7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 08:59:59.928661 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a85803c7-7e50-4743-9987-882aecc991b7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.226612 Aug 24 08:59:59.929516 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 281/562] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 08:59:59 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:00.104232 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-27ed80b4-f516-43e6-8655-28f49f308778 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:00.104842 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-27ed80b4-f516-43e6-8655-28f49f308778 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:00.111872 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27ed80b4-f516-43e6-8655-28f49f308778 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:00.112393 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27ed80b4-f516-43e6-8655-28f49f308778 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:00.112833 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27ed80b4-f516-43e6-8655-28f49f308778 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:00.113532 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27ed80b4-f516-43e6-8655-28f49f308778 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:00.114040 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27ed80b4-f516-43e6-8655-28f49f308778 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:00.114463 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27ed80b4-f516-43e6-8655-28f49f308778 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:00.250129 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-27ed80b4-f516-43e6-8655-28f49f308778 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:00.259536 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-27ed80b4-f516-43e6-8655-28f49f308778 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1725 microversion: 2.1 time: 0.159198 Aug 24 09:00:00.260124 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 282/563] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:00 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:00.943427 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f86feecb-3dd3-4976-bb76-58715784320e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:00.944130 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f86feecb-3dd3-4976-bb76-58715784320e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:00.951646 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-add26f1a-ab99-4ce7-ab45-83c69eae0435 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:00.952424 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-add26f1a-ab99-4ce7-ab45-83c69eae0435 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:00.952932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f86feecb-3dd3-4976-bb76-58715784320e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:00.953908 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f86feecb-3dd3-4976-bb76-58715784320e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:00.954422 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f86feecb-3dd3-4976-bb76-58715784320e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:00.955338 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f86feecb-3dd3-4976-bb76-58715784320e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:00.955738 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f86feecb-3dd3-4976-bb76-58715784320e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:00.956279 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f86feecb-3dd3-4976-bb76-58715784320e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:00.958370 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-add26f1a-ab99-4ce7-ab45-83c69eae0435 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:00.958864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-add26f1a-ab99-4ce7-ab45-83c69eae0435 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:00.959309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-add26f1a-ab99-4ce7-ab45-83c69eae0435 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:00.960179 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-add26f1a-ab99-4ce7-ab45-83c69eae0435 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:00.960968 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-add26f1a-ab99-4ce7-ab45-83c69eae0435 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:00.960968 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-add26f1a-ab99-4ce7-ab45-83c69eae0435 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:01.158407 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-add26f1a-ab99-4ce7-ab45-83c69eae0435 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:01.168840 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f86feecb-3dd3-4976-bb76-58715784320e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:01.169461 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-add26f1a-ab99-4ce7-ab45-83c69eae0435 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:01.170991 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-add26f1a-ab99-4ce7-ab45-83c69eae0435 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:01.173147 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-add26f1a-ab99-4ce7-ab45-83c69eae0435 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.226342 Aug 24 09:00:01.173710 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 283/564] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:00 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:01.177712 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f86feecb-3dd3-4976-bb76-58715784320e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1267 microversion: 2.1 time: 0.238873 Aug 24 09:00:01.178404 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 282/565] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:00 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:01.178534 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-36b25749-760d-4f02-9757-d538a017b9bd req-7416f701-5307-47cf-b01b-48eb5df8f085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dff703e-fd9a-4783-9b0d-98337571e993", "name": "network-vif-plugged", "status": "completed", "tag": "7996caca-db82-4075-943a-f06676d4fa8c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:01.188764 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-36b25749-760d-4f02-9757-d538a017b9bd req-7416f701-5307-47cf-b01b-48eb5df8f085 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:01.189244 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-36b25749-760d-4f02-9757-d538a017b9bd req-7416f701-5307-47cf-b01b-48eb5df8f085 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:01.189677 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-36b25749-760d-4f02-9757-d538a017b9bd req-7416f701-5307-47cf-b01b-48eb5df8f085 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:01.200755 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-36b25749-760d-4f02-9757-d538a017b9bd req-7416f701-5307-47cf-b01b-48eb5df8f085 service nova] Creating event network-vif-plugged:7996caca-db82-4075-943a-f06676d4fa8c for instance 2dff703e-fd9a-4783-9b0d-98337571e993 on hv-cinder-83538 Aug 24 09:00:01.206284 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-36b25749-760d-4f02-9757-d538a017b9bd req-7416f701-5307-47cf-b01b-48eb5df8f085 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031261 Aug 24 09:00:01.206882 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 284/566] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:00:01.281883 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-820c69b3-9dc7-447d-a5d7-511691be5dd0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:01.282492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-820c69b3-9dc7-447d-a5d7-511691be5dd0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:01.289273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-820c69b3-9dc7-447d-a5d7-511691be5dd0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:01.289767 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-820c69b3-9dc7-447d-a5d7-511691be5dd0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:01.290192 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-820c69b3-9dc7-447d-a5d7-511691be5dd0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:01.290882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-820c69b3-9dc7-447d-a5d7-511691be5dd0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:01.291331 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-820c69b3-9dc7-447d-a5d7-511691be5dd0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:01.291747 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-820c69b3-9dc7-447d-a5d7-511691be5dd0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:01.432156 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-820c69b3-9dc7-447d-a5d7-511691be5dd0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:01.440786 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-820c69b3-9dc7-447d-a5d7-511691be5dd0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1725 microversion: 2.1 time: 0.163336 Aug 24 09:00:01.441364 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 283/567] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:01 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:02.199104 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-17cc8f03-b28d-4cde-9d68-67e40aef6c8d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:02.199699 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fafdd1b3-a86a-444c-8f33-d49a1473a41e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:02.200128 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-17cc8f03-b28d-4cde-9d68-67e40aef6c8d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:02.200461 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fafdd1b3-a86a-444c-8f33-d49a1473a41e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:02.208312 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fafdd1b3-a86a-444c-8f33-d49a1473a41e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:02.209415 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fafdd1b3-a86a-444c-8f33-d49a1473a41e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:02.210099 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fafdd1b3-a86a-444c-8f33-d49a1473a41e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:02.210908 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fafdd1b3-a86a-444c-8f33-d49a1473a41e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:02.211597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fafdd1b3-a86a-444c-8f33-d49a1473a41e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:02.212269 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fafdd1b3-a86a-444c-8f33-d49a1473a41e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:02.221102 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17cc8f03-b28d-4cde-9d68-67e40aef6c8d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:02.223442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17cc8f03-b28d-4cde-9d68-67e40aef6c8d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:02.223920 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17cc8f03-b28d-4cde-9d68-67e40aef6c8d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:02.227557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17cc8f03-b28d-4cde-9d68-67e40aef6c8d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:02.228841 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17cc8f03-b28d-4cde-9d68-67e40aef6c8d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:02.229435 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17cc8f03-b28d-4cde-9d68-67e40aef6c8d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:02.441257 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-fafdd1b3-a86a-444c-8f33-d49a1473a41e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:02.449902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-17cc8f03-b28d-4cde-9d68-67e40aef6c8d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:02.450191 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fafdd1b3-a86a-444c-8f33-d49a1473a41e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1267 microversion: 2.1 time: 0.255286 Aug 24 09:00:02.450840 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 284/568] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:02 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1267 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:02.463403 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-17cc8f03-b28d-4cde-9d68-67e40aef6c8d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:02.463403 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-17cc8f03-b28d-4cde-9d68-67e40aef6c8d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:02.463403 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-17cc8f03-b28d-4cde-9d68-67e40aef6c8d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.268520 Aug 24 09:00:02.464481 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 285/569] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:02 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:02.468995 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2226a6e0-b4be-4664-9480-50c0b66c274e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:02.469763 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2226a6e0-b4be-4664-9480-50c0b66c274e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:02.476168 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2226a6e0-b4be-4664-9480-50c0b66c274e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:02.476971 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2226a6e0-b4be-4664-9480-50c0b66c274e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:02.477751 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2226a6e0-b4be-4664-9480-50c0b66c274e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:02.478451 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2226a6e0-b4be-4664-9480-50c0b66c274e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:02.478902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2226a6e0-b4be-4664-9480-50c0b66c274e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:02.479324 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2226a6e0-b4be-4664-9480-50c0b66c274e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:02.658096 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2226a6e0-b4be-4664-9480-50c0b66c274e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:02.666233 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2226a6e0-b4be-4664-9480-50c0b66c274e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1702 microversion: 2.1 time: 0.201541 Aug 24 09:00:02.666800 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 286/570] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:02 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1702 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:02.686530 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6cf4f1df-1804-4220-a1e2-4dbfafd713e9 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:02.692652 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cf4f1df-1804-4220-a1e2-4dbfafd713e9 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:02.693140 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cf4f1df-1804-4220-a1e2-4dbfafd713e9 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:02.693577 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6cf4f1df-1804-4220-a1e2-4dbfafd713e9 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:02.754810 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6cf4f1df-1804-4220-a1e2-4dbfafd713e9 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Going to try to start instance {{(pid=120543) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 09:00:02.800352 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6cf4f1df-1804-4220-a1e2-4dbfafd713e9 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "POST /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/action" status: 202 len: 0 microversion: 2.1 time: 0.117483 Aug 24 09:00:02.800962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 285/571] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 24 09:00:02 2022] POST /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 09:00:02.809295 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6684dbbd-1ee5-460c-88df-442411ea26f8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:02.809995 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6684dbbd-1ee5-460c-88df-442411ea26f8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:02.812000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=59 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:02.818098 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6684dbbd-1ee5-460c-88df-442411ea26f8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:02.818594 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6684dbbd-1ee5-460c-88df-442411ea26f8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:02.819042 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6684dbbd-1ee5-460c-88df-442411ea26f8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:02.819753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6684dbbd-1ee5-460c-88df-442411ea26f8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:02.820248 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6684dbbd-1ee5-460c-88df-442411ea26f8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:02.820680 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6684dbbd-1ee5-460c-88df-442411ea26f8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:02.966679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6684dbbd-1ee5-460c-88df-442411ea26f8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:02.977135 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6684dbbd-1ee5-460c-88df-442411ea26f8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1711 microversion: 2.1 time: 0.171668 Aug 24 09:00:02.989226 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 287/572] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:02 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1711 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:03.471947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-62f846db-31b4-4cfa-864d-f323701559d3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:03.472723 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-62f846db-31b4-4cfa-864d-f323701559d3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:03.479518 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62f846db-31b4-4cfa-864d-f323701559d3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:03.480021 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62f846db-31b4-4cfa-864d-f323701559d3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:03.480465 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62f846db-31b4-4cfa-864d-f323701559d3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:03.481154 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62f846db-31b4-4cfa-864d-f323701559d3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:03.481606 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62f846db-31b4-4cfa-864d-f323701559d3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:03.482022 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62f846db-31b4-4cfa-864d-f323701559d3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:03.488517 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-719c9bad-b3c0-44a9-9af0-4d371802a7db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:03.489997 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-719c9bad-b3c0-44a9-9af0-4d371802a7db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:03.496192 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-719c9bad-b3c0-44a9-9af0-4d371802a7db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:03.496690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-719c9bad-b3c0-44a9-9af0-4d371802a7db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:03.497132 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-719c9bad-b3c0-44a9-9af0-4d371802a7db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:03.497835 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-719c9bad-b3c0-44a9-9af0-4d371802a7db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:03.498462 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-719c9bad-b3c0-44a9-9af0-4d371802a7db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:03.498896 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-719c9bad-b3c0-44a9-9af0-4d371802a7db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:03.688713 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-62f846db-31b4-4cfa-864d-f323701559d3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:03.693395 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-719c9bad-b3c0-44a9-9af0-4d371802a7db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:03.696789 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-62f846db-31b4-4cfa-864d-f323701559d3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1267 microversion: 2.1 time: 0.229752 Aug 24 09:00:03.697365 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 286/573] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:03 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:03.702551 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-719c9bad-b3c0-44a9-9af0-4d371802a7db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:03.704198 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-719c9bad-b3c0-44a9-9af0-4d371802a7db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:03.705309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-719c9bad-b3c0-44a9-9af0-4d371802a7db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1741 microversion: 2.20 time: 0.221170 Aug 24 09:00:03.713809 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 288/574] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:03 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1741 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:03.999517 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0ba267a3-14e5-47ed-a42c-a14337faf69c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:04.000235 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0ba267a3-14e5-47ed-a42c-a14337faf69c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:04.006278 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ba267a3-14e5-47ed-a42c-a14337faf69c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:04.007029 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ba267a3-14e5-47ed-a42c-a14337faf69c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:04.007466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ba267a3-14e5-47ed-a42c-a14337faf69c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:04.008191 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ba267a3-14e5-47ed-a42c-a14337faf69c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:04.008658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ba267a3-14e5-47ed-a42c-a14337faf69c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:04.009086 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0ba267a3-14e5-47ed-a42c-a14337faf69c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:04.223806 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0ba267a3-14e5-47ed-a42c-a14337faf69c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:04.232052 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0ba267a3-14e5-47ed-a42c-a14337faf69c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1711 microversion: 2.1 time: 0.237471 Aug 24 09:00:04.232658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 287/575] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:03 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1711 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:04.717665 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8ecbe70d-b38d-4281-ac53-40c2264f197e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:04.718293 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8ecbe70d-b38d-4281-ac53-40c2264f197e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:04.725016 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ecbe70d-b38d-4281-ac53-40c2264f197e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:04.725758 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ecbe70d-b38d-4281-ac53-40c2264f197e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:04.726196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ecbe70d-b38d-4281-ac53-40c2264f197e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:04.727116 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ecbe70d-b38d-4281-ac53-40c2264f197e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:04.727717 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ecbe70d-b38d-4281-ac53-40c2264f197e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:04.728328 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8ecbe70d-b38d-4281-ac53-40c2264f197e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:04.729845 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-88f2ba58-ef80-41fc-9d8b-275b70b983ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:04.730542 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-88f2ba58-ef80-41fc-9d8b-275b70b983ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:04.738227 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88f2ba58-ef80-41fc-9d8b-275b70b983ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:04.738719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88f2ba58-ef80-41fc-9d8b-275b70b983ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:04.739161 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88f2ba58-ef80-41fc-9d8b-275b70b983ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:04.739866 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88f2ba58-ef80-41fc-9d8b-275b70b983ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:04.740359 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88f2ba58-ef80-41fc-9d8b-275b70b983ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:04.740790 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88f2ba58-ef80-41fc-9d8b-275b70b983ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:04.943104 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-88f2ba58-ef80-41fc-9d8b-275b70b983ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:04.949566 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8ecbe70d-b38d-4281-ac53-40c2264f197e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:04.953030 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-88f2ba58-ef80-41fc-9d8b-275b70b983ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:04.954825 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-88f2ba58-ef80-41fc-9d8b-275b70b983ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:04.956144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-88f2ba58-ef80-41fc-9d8b-275b70b983ad tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1741 microversion: 2.20 time: 0.230660 Aug 24 09:00:04.963565 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 288/576] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:04 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:04.963775 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8ecbe70d-b38d-4281-ac53-40c2264f197e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1267 microversion: 2.1 time: 0.244123 Aug 24 09:00:04.963775 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 289/577] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:04 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:04.976611 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-5554058f-5bc7-470b-8328-8674f26507f1 req-491e645e-7a24-4e7c-a381-dc1449b86325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4866e8f4-ddfe-4cee-8bcc-5db7372926f5", "name": "network-vif-plugged", "status": "completed", "tag": "4e1f25c9-676d-433c-8c1b-ae79e13a1625"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:04.988240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5554058f-5bc7-470b-8328-8674f26507f1 req-491e645e-7a24-4e7c-a381-dc1449b86325 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:04.988731 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5554058f-5bc7-470b-8328-8674f26507f1 req-491e645e-7a24-4e7c-a381-dc1449b86325 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:04.989300 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5554058f-5bc7-470b-8328-8674f26507f1 req-491e645e-7a24-4e7c-a381-dc1449b86325 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:04.993587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:05.001719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-5554058f-5bc7-470b-8328-8674f26507f1 req-491e645e-7a24-4e7c-a381-dc1449b86325 service nova] Creating event network-vif-plugged:4e1f25c9-676d-433c-8c1b-ae79e13a1625 for instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 on hv-cinder-83538 Aug 24 09:00:05.007109 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-5554058f-5bc7-470b-8328-8674f26507f1 req-491e645e-7a24-4e7c-a381-dc1449b86325 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033869 Aug 24 09:00:05.007877 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 289/578] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:00:05.253219 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9b319051-22ba-4c39-878d-daaaadb32004 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:05.253830 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9b319051-22ba-4c39-878d-daaaadb32004 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:05.260352 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b319051-22ba-4c39-878d-daaaadb32004 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:05.260843 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b319051-22ba-4c39-878d-daaaadb32004 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:05.261283 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b319051-22ba-4c39-878d-daaaadb32004 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:05.261978 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b319051-22ba-4c39-878d-daaaadb32004 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:05.262445 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b319051-22ba-4c39-878d-daaaadb32004 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:05.262877 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9b319051-22ba-4c39-878d-daaaadb32004 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:05.407149 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9b319051-22ba-4c39-878d-daaaadb32004 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:05.415890 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9b319051-22ba-4c39-878d-daaaadb32004 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1711 microversion: 2.1 time: 0.166684 Aug 24 09:00:05.416505 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 290/579] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:05 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1711 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:05.980018 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-09503569-426f-456f-9877-e0091379e4ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:05.980688 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-79bec856-275c-4434-b112-4d5a7abba6ba tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:05.981098 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-09503569-426f-456f-9877-e0091379e4ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:05.981359 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-79bec856-275c-4434-b112-4d5a7abba6ba tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:05.987966 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09503569-426f-456f-9877-e0091379e4ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:05.988767 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09503569-426f-456f-9877-e0091379e4ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:05.988927 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79bec856-275c-4434-b112-4d5a7abba6ba tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:05.989213 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09503569-426f-456f-9877-e0091379e4ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:05.989548 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79bec856-275c-4434-b112-4d5a7abba6ba tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:05.989920 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09503569-426f-456f-9877-e0091379e4ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:05.990100 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79bec856-275c-4434-b112-4d5a7abba6ba tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:05.990379 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09503569-426f-456f-9877-e0091379e4ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:05.990811 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09503569-426f-456f-9877-e0091379e4ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:05.990984 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79bec856-275c-4434-b112-4d5a7abba6ba tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:05.991503 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79bec856-275c-4434-b112-4d5a7abba6ba tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:05.991994 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-79bec856-275c-4434-b112-4d5a7abba6ba tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:06.193570 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-09503569-426f-456f-9877-e0091379e4ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:06.200888 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-79bec856-275c-4434-b112-4d5a7abba6ba tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:06.201846 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-09503569-426f-456f-9877-e0091379e4ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1453 microversion: 2.1 time: 0.225670 Aug 24 09:00:06.202433 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 291/580] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:05 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1453 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:06.209894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-79bec856-275c-4434-b112-4d5a7abba6ba tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:06.211412 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-79bec856-275c-4434-b112-4d5a7abba6ba tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:06.212811 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-79bec856-275c-4434-b112-4d5a7abba6ba tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1741 microversion: 2.20 time: 0.237697 Aug 24 09:00:06.213362 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 290/581] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:05 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1741 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:06.223638 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8eae76d2-60fd-446f-9694-61436bf6e220 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:06.224293 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8eae76d2-60fd-446f-9694-61436bf6e220 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:06.230246 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eae76d2-60fd-446f-9694-61436bf6e220 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:06.230737 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eae76d2-60fd-446f-9694-61436bf6e220 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:06.231180 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eae76d2-60fd-446f-9694-61436bf6e220 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:06.231881 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eae76d2-60fd-446f-9694-61436bf6e220 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:06.232372 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eae76d2-60fd-446f-9694-61436bf6e220 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:06.232805 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8eae76d2-60fd-446f-9694-61436bf6e220 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:06.367564 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8eae76d2-60fd-446f-9694-61436bf6e220 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:06.375379 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8eae76d2-60fd-446f-9694-61436bf6e220 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1453 microversion: 2.1 time: 0.156216 Aug 24 09:00:06.375948 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 292/582] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:06 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:06.437209 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-977251a4-5791-45ec-ab0d-800efef058a5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:06.437830 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-977251a4-5791-45ec-ab0d-800efef058a5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:06.444019 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-977251a4-5791-45ec-ab0d-800efef058a5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:06.444543 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-977251a4-5791-45ec-ab0d-800efef058a5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:06.444981 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-977251a4-5791-45ec-ab0d-800efef058a5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:06.445686 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-977251a4-5791-45ec-ab0d-800efef058a5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:06.446145 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-977251a4-5791-45ec-ab0d-800efef058a5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:06.446568 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-977251a4-5791-45ec-ab0d-800efef058a5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:06.583030 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-977251a4-5791-45ec-ab0d-800efef058a5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:06.591708 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-977251a4-5791-45ec-ab0d-800efef058a5 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1715 microversion: 2.1 time: 0.158374 Aug 24 09:00:06.592512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 291/583] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:06 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:07.237351 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2212a05f-03b3-40a5-9c72-3e219f7e68c3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:07.238863 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2212a05f-03b3-40a5-9c72-3e219f7e68c3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:07.246384 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2212a05f-03b3-40a5-9c72-3e219f7e68c3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:07.246953 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2212a05f-03b3-40a5-9c72-3e219f7e68c3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:07.247505 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2212a05f-03b3-40a5-9c72-3e219f7e68c3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:07.248609 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2212a05f-03b3-40a5-9c72-3e219f7e68c3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:07.249131 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2212a05f-03b3-40a5-9c72-3e219f7e68c3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:07.249773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2212a05f-03b3-40a5-9c72-3e219f7e68c3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:07.271518 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:07.576740 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2212a05f-03b3-40a5-9c72-3e219f7e68c3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:07.586011 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2212a05f-03b3-40a5-9c72-3e219f7e68c3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:07.587983 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2212a05f-03b3-40a5-9c72-3e219f7e68c3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:07.589217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2212a05f-03b3-40a5-9c72-3e219f7e68c3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1741 microversion: 2.20 time: 0.357355 Aug 24 09:00:07.589779 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 293/584] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:07 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1741 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:08.614317 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d32aabcc-8aa2-4ba4-afd0-bf9a7112c1f9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:08.615339 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-4c23ff42-4504-455f-ad0e-dc19533f9d5e req-b8e99343-e172-41f3-ade9-b0b95e115373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dff703e-fd9a-4783-9b0d-98337571e993", "tag": "7996caca-db82-4075-943a-f06676d4fa8c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:08.616703 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d32aabcc-8aa2-4ba4-afd0-bf9a7112c1f9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:08.625997 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4c23ff42-4504-455f-ad0e-dc19533f9d5e req-b8e99343-e172-41f3-ade9-b0b95e115373 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:08.626487 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4c23ff42-4504-455f-ad0e-dc19533f9d5e req-b8e99343-e172-41f3-ade9-b0b95e115373 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:08.627106 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4c23ff42-4504-455f-ad0e-dc19533f9d5e req-b8e99343-e172-41f3-ade9-b0b95e115373 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:08.630488 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:08.634334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d32aabcc-8aa2-4ba4-afd0-bf9a7112c1f9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:08.635170 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d32aabcc-8aa2-4ba4-afd0-bf9a7112c1f9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:08.636033 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d32aabcc-8aa2-4ba4-afd0-bf9a7112c1f9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:08.638003 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d32aabcc-8aa2-4ba4-afd0-bf9a7112c1f9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:08.638868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d32aabcc-8aa2-4ba4-afd0-bf9a7112c1f9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:08.639535 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d32aabcc-8aa2-4ba4-afd0-bf9a7112c1f9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:08.640041 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-4c23ff42-4504-455f-ad0e-dc19533f9d5e req-b8e99343-e172-41f3-ade9-b0b95e115373 service nova] Creating event network-changed:7996caca-db82-4075-943a-f06676d4fa8c for instance 2dff703e-fd9a-4783-9b0d-98337571e993 on hv-cinder-83538 Aug 24 09:00:08.646490 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-4c23ff42-4504-455f-ad0e-dc19533f9d5e req-b8e99343-e172-41f3-ade9-b0b95e115373 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034576 Aug 24 09:00:08.647332 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 294/585] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:00:08.923088 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d32aabcc-8aa2-4ba4-afd0-bf9a7112c1f9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:08.934002 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d32aabcc-8aa2-4ba4-afd0-bf9a7112c1f9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:08.940085 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d32aabcc-8aa2-4ba4-afd0-bf9a7112c1f9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:08.943990 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d32aabcc-8aa2-4ba4-afd0-bf9a7112c1f9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1741 microversion: 2.20 time: 0.334802 Aug 24 09:00:08.945369 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 292/586] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:08 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1741 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:09.969482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-27cc2ced-423d-4524-916f-f85d7769b0a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:09.970416 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-27cc2ced-423d-4524-916f-f85d7769b0a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:09.977558 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27cc2ced-423d-4524-916f-f85d7769b0a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:09.978055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27cc2ced-423d-4524-916f-f85d7769b0a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:09.978753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27cc2ced-423d-4524-916f-f85d7769b0a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:09.979557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27cc2ced-423d-4524-916f-f85d7769b0a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:09.980180 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27cc2ced-423d-4524-916f-f85d7769b0a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:09.980592 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27cc2ced-423d-4524-916f-f85d7769b0a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:10.134595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-27cc2ced-423d-4524-916f-f85d7769b0a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:10.143738 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-27cc2ced-423d-4524-916f-f85d7769b0a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:10.145277 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-27cc2ced-423d-4524-916f-f85d7769b0a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:10.146437 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-27cc2ced-423d-4524-916f-f85d7769b0a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1741 microversion: 2.20 time: 0.182789 Aug 24 09:00:10.146990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 295/587] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:09 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:11.170346 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a81c20eb-ffdb-451b-ac47-e0b655a8d861 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:11.171061 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a81c20eb-ffdb-451b-ac47-e0b655a8d861 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:11.181864 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a81c20eb-ffdb-451b-ac47-e0b655a8d861 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:11.182633 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a81c20eb-ffdb-451b-ac47-e0b655a8d861 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:11.184509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a81c20eb-ffdb-451b-ac47-e0b655a8d861 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:11.192806 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a81c20eb-ffdb-451b-ac47-e0b655a8d861 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:11.193400 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a81c20eb-ffdb-451b-ac47-e0b655a8d861 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:11.193915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a81c20eb-ffdb-451b-ac47-e0b655a8d861 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:11.448356 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a81c20eb-ffdb-451b-ac47-e0b655a8d861 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:11.462164 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a81c20eb-ffdb-451b-ac47-e0b655a8d861 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:11.463851 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a81c20eb-ffdb-451b-ac47-e0b655a8d861 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:11.465107 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a81c20eb-ffdb-451b-ac47-e0b655a8d861 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1736 microversion: 2.20 time: 0.299033 Aug 24 09:00:11.479922 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 293/588] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:11 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1736 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:12.470555 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-314f1930-71cd-4348-be81-e0cc85011738 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:12.472418 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-314f1930-71cd-4348-be81-e0cc85011738 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:12.479059 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-314f1930-71cd-4348-be81-e0cc85011738 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:12.479818 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-314f1930-71cd-4348-be81-e0cc85011738 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:12.480447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-314f1930-71cd-4348-be81-e0cc85011738 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:12.481706 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-314f1930-71cd-4348-be81-e0cc85011738 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:12.494014 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-34ef24b9-0a2a-4118-94c1-ce7eca5bc1c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:12.494737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-34ef24b9-0a2a-4118-94c1-ce7eca5bc1c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:12.495100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-314f1930-71cd-4348-be81-e0cc85011738 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:12.497176 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-314f1930-71cd-4348-be81-e0cc85011738 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:12.502435 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ef24b9-0a2a-4118-94c1-ce7eca5bc1c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:12.503239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ef24b9-0a2a-4118-94c1-ce7eca5bc1c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:12.503952 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ef24b9-0a2a-4118-94c1-ce7eca5bc1c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:12.504914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ef24b9-0a2a-4118-94c1-ce7eca5bc1c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:12.505590 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ef24b9-0a2a-4118-94c1-ce7eca5bc1c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:12.506418 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-34ef24b9-0a2a-4118-94c1-ce7eca5bc1c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:12.539223 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-314f1930-71cd-4348-be81-e0cc85011738 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645/ips" status: 200 len: 148 microversion: 2.1 time: 0.074078 Aug 24 09:00:12.540163 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 296/589] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 24 09:00:12 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645/ips => generated 148 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:00:12.681369 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-34ef24b9-0a2a-4118-94c1-ce7eca5bc1c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:12.694277 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-34ef24b9-0a2a-4118-94c1-ce7eca5bc1c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:12.698001 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-34ef24b9-0a2a-4118-94c1-ce7eca5bc1c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:12.702979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-34ef24b9-0a2a-4118-94c1-ce7eca5bc1c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1736 microversion: 2.20 time: 0.212272 Aug 24 09:00:12.721299 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 294/590] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:12 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:13.730259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-08d27503-9bad-4bf8-bdad-478c3aeb2935 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:13.730985 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-08d27503-9bad-4bf8-bdad-478c3aeb2935 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:13.739585 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08d27503-9bad-4bf8-bdad-478c3aeb2935 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:13.740081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08d27503-9bad-4bf8-bdad-478c3aeb2935 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:13.740579 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08d27503-9bad-4bf8-bdad-478c3aeb2935 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:13.741290 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08d27503-9bad-4bf8-bdad-478c3aeb2935 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:13.741911 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08d27503-9bad-4bf8-bdad-478c3aeb2935 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:13.743039 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-08d27503-9bad-4bf8-bdad-478c3aeb2935 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:13.885473 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-08d27503-9bad-4bf8-bdad-478c3aeb2935 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:13.901736 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-08d27503-9bad-4bf8-bdad-478c3aeb2935 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:13.903669 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-08d27503-9bad-4bf8-bdad-478c3aeb2935 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:13.905005 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-08d27503-9bad-4bf8-bdad-478c3aeb2935 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1736 microversion: 2.20 time: 0.178735 Aug 24 09:00:13.908265 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 297/591] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:13 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:14.927790 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1d70ceef-1ec0-41a0-a195-1aac012a044b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:14.929148 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1d70ceef-1ec0-41a0-a195-1aac012a044b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:14.939308 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d70ceef-1ec0-41a0-a195-1aac012a044b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:14.939824 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d70ceef-1ec0-41a0-a195-1aac012a044b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:14.940334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d70ceef-1ec0-41a0-a195-1aac012a044b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:14.941052 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d70ceef-1ec0-41a0-a195-1aac012a044b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:14.941514 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d70ceef-1ec0-41a0-a195-1aac012a044b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:14.941949 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1d70ceef-1ec0-41a0-a195-1aac012a044b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:15.208159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1d70ceef-1ec0-41a0-a195-1aac012a044b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:15.229340 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1d70ceef-1ec0-41a0-a195-1aac012a044b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:15.233463 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1d70ceef-1ec0-41a0-a195-1aac012a044b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:15.236048 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1d70ceef-1ec0-41a0-a195-1aac012a044b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1736 microversion: 2.20 time: 0.312989 Aug 24 09:00:15.237822 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 295/592] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:14 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1736 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:16.266276 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cf4a0977-32f3-4102-834e-290530fcd440 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:16.266901 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cf4a0977-32f3-4102-834e-290530fcd440 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:16.284369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf4a0977-32f3-4102-834e-290530fcd440 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:16.286025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf4a0977-32f3-4102-834e-290530fcd440 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:16.288562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf4a0977-32f3-4102-834e-290530fcd440 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:16.289482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf4a0977-32f3-4102-834e-290530fcd440 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:16.293247 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf4a0977-32f3-4102-834e-290530fcd440 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:16.293942 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cf4a0977-32f3-4102-834e-290530fcd440 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:16.314431 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2362c64e-72c9-486f-825c-f77a49fedc29 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e6ae117-b462-4b3a-bdc9-b46ad034d10b"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:16.317007 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2362c64e-72c9-486f-825c-f77a49fedc29 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:16.346395 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2362c64e-72c9-486f-825c-f77a49fedc29 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:16.351259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2362c64e-72c9-486f-825c-f77a49fedc29 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:16.353219 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2362c64e-72c9-486f-825c-f77a49fedc29 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:16.357096 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2362c64e-72c9-486f-825c-f77a49fedc29 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:16.357586 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2362c64e-72c9-486f-825c-f77a49fedc29 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:16.362336 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2362c64e-72c9-486f-825c-f77a49fedc29 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:16.680060 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cf4a0977-32f3-4102-834e-290530fcd440 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:16.690188 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cf4a0977-32f3-4102-834e-290530fcd440 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:16.698386 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cf4a0977-32f3-4102-834e-290530fcd440 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:16.699664 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cf4a0977-32f3-4102-834e-290530fcd440 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1736 microversion: 2.20 time: 0.440239 Aug 24 09:00:16.704835 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 298/593] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:16 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1736 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:16.942092 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2362c64e-72c9-486f-825c-f77a49fedc29 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "POST /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.613525 Aug 24 09:00:16.945575 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 296/594] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 24 09:00:16 2022] POST /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645/os-volume_attachments => generated 194 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:00:17.726029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2f14eb33-cabf-462e-afed-618e1929bfa2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:17.727171 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2f14eb33-cabf-462e-afed-618e1929bfa2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:17.740438 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f14eb33-cabf-462e-afed-618e1929bfa2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:17.741180 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f14eb33-cabf-462e-afed-618e1929bfa2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:17.741794 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f14eb33-cabf-462e-afed-618e1929bfa2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:17.747752 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f14eb33-cabf-462e-afed-618e1929bfa2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:17.757099 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f14eb33-cabf-462e-afed-618e1929bfa2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:17.757644 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f14eb33-cabf-462e-afed-618e1929bfa2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:18.060822 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2f14eb33-cabf-462e-afed-618e1929bfa2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:18.098557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2f14eb33-cabf-462e-afed-618e1929bfa2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:18.103682 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2f14eb33-cabf-462e-afed-618e1929bfa2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:18.107195 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2f14eb33-cabf-462e-afed-618e1929bfa2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1736 microversion: 2.20 time: 0.385084 Aug 24 09:00:18.109380 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 299/595] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:17 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1736 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:19.134062 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e528f42b-2a53-4316-aeb2-f4d8571c2459 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:19.135529 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e528f42b-2a53-4316-aeb2-f4d8571c2459 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:19.146735 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e528f42b-2a53-4316-aeb2-f4d8571c2459 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:19.147246 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e528f42b-2a53-4316-aeb2-f4d8571c2459 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:19.147691 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e528f42b-2a53-4316-aeb2-f4d8571c2459 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:19.148443 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e528f42b-2a53-4316-aeb2-f4d8571c2459 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:19.148907 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e528f42b-2a53-4316-aeb2-f4d8571c2459 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:19.149342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e528f42b-2a53-4316-aeb2-f4d8571c2459 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:19.512047 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e528f42b-2a53-4316-aeb2-f4d8571c2459 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:19.530276 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e528f42b-2a53-4316-aeb2-f4d8571c2459 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:19.533702 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e528f42b-2a53-4316-aeb2-f4d8571c2459 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:19.541672 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e528f42b-2a53-4316-aeb2-f4d8571c2459 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1736 microversion: 2.20 time: 0.412751 Aug 24 09:00:19.542977 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 297/596] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:19 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1736 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:20.582102 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-09413d80-9450-4cc7-898a-efd9bf1b6710 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:20.582839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-09413d80-9450-4cc7-898a-efd9bf1b6710 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:20.601047 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09413d80-9450-4cc7-898a-efd9bf1b6710 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:20.604898 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09413d80-9450-4cc7-898a-efd9bf1b6710 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:20.605635 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09413d80-9450-4cc7-898a-efd9bf1b6710 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:20.608584 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09413d80-9450-4cc7-898a-efd9bf1b6710 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:20.609559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09413d80-9450-4cc7-898a-efd9bf1b6710 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:20.611111 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-09413d80-9450-4cc7-898a-efd9bf1b6710 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:20.983036 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-09413d80-9450-4cc7-898a-efd9bf1b6710 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:20.993515 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-09413d80-9450-4cc7-898a-efd9bf1b6710 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:21.003545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-09413d80-9450-4cc7-898a-efd9bf1b6710 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:21.007902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-09413d80-9450-4cc7-898a-efd9bf1b6710 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1736 microversion: 2.20 time: 0.433699 Aug 24 09:00:21.013014 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 300/597] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:20 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1736 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:22.036269 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e4697c1c-9e35-45ab-b646-de9fd670754c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:22.037923 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e4697c1c-9e35-45ab-b646-de9fd670754c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:22.059956 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4697c1c-9e35-45ab-b646-de9fd670754c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:22.061012 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4697c1c-9e35-45ab-b646-de9fd670754c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:22.061633 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4697c1c-9e35-45ab-b646-de9fd670754c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:22.063334 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4697c1c-9e35-45ab-b646-de9fd670754c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:22.065618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4697c1c-9e35-45ab-b646-de9fd670754c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:22.066251 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e4697c1c-9e35-45ab-b646-de9fd670754c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:22.305077 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e4697c1c-9e35-45ab-b646-de9fd670754c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:22.322166 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e4697c1c-9e35-45ab-b646-de9fd670754c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:22.324481 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e4697c1c-9e35-45ab-b646-de9fd670754c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:22.326358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e4697c1c-9e35-45ab-b646-de9fd670754c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1736 microversion: 2.20 time: 0.295071 Aug 24 09:00:22.327682 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 301/598] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:22 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1736 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:22.480337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2faeee28-cb01-4b54-9cb9-dba730f4ad17 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Action: 'create', calling method: .version_select at 0x7fb14572c430>, body: {"keypair": {"name": "tempest-TestShelveInstance-333958261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3lXk/adg6IEsUxtOuGfaiE0/lAHNaTsswRAoN6Lio2PRcBPqtRi+6Rp1QMkVEvLeUure8Im0vVojdDtYvr2YQ38q57WA0uufFtmb3IF0cNMANkyUKQaBNUVM8xPgkRKA=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:22.500751 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-2faeee28-cb01-4b54-9cb9-dba730f4ad17 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Getting quotas for project 3d68ee6e33664bbfba3b239f16fbbaa0. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:00:22.505947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-2faeee28-cb01-4b54-9cb9-dba730f4ad17 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Getting quotas for user edc56fc598e741ceab98edd3b9afa28c and project 3d68ee6e33664bbfba3b239f16fbbaa0. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:00:22.540293 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2faeee28-cb01-4b54-9cb9-dba730f4ad17 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.590042 Aug 24 09:00:22.541702 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 298/599] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 24 09:00:21 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:00:23.351355 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cc3116e8-3ec2-404e-a9ab-c67be39e7554 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:23.352209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cc3116e8-3ec2-404e-a9ab-c67be39e7554 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:23.362454 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc3116e8-3ec2-404e-a9ab-c67be39e7554 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:23.366526 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc3116e8-3ec2-404e-a9ab-c67be39e7554 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:23.367158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc3116e8-3ec2-404e-a9ab-c67be39e7554 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:23.368196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc3116e8-3ec2-404e-a9ab-c67be39e7554 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:23.370525 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc3116e8-3ec2-404e-a9ab-c67be39e7554 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:23.371286 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cc3116e8-3ec2-404e-a9ab-c67be39e7554 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:23.609935 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cc3116e8-3ec2-404e-a9ab-c67be39e7554 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:23.618650 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cc3116e8-3ec2-404e-a9ab-c67be39e7554 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:23.620387 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cc3116e8-3ec2-404e-a9ab-c67be39e7554 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:23.621872 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cc3116e8-3ec2-404e-a9ab-c67be39e7554 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1736 microversion: 2.20 time: 0.274823 Aug 24 09:00:23.622551 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 302/600] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:23 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1736 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:24.226464 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1582588883", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:24.344643 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] validate_networks() for None {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:00:24.649095 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f4e28a1a-cd9e-4c8d-8fe7-17198ac92c2c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:24.652822 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f4e28a1a-cd9e-4c8d-8fe7-17198ac92c2c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:24.666164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4e28a1a-cd9e-4c8d-8fe7-17198ac92c2c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:24.673731 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4e28a1a-cd9e-4c8d-8fe7-17198ac92c2c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:24.674661 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4e28a1a-cd9e-4c8d-8fe7-17198ac92c2c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:24.675509 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4e28a1a-cd9e-4c8d-8fe7-17198ac92c2c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:24.675991 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4e28a1a-cd9e-4c8d-8fe7-17198ac92c2c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:24.676463 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f4e28a1a-cd9e-4c8d-8fe7-17198ac92c2c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:25.295779 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:00:25.296303 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:00:25.296936 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:00:25.297483 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:00:25.298668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:00:25.311645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:25.312170 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:25.312902 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:25.315412 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:25.316133 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:25.316753 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:25.325430 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f4e28a1a-cd9e-4c8d-8fe7-17198ac92c2c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:25.334334 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f4e28a1a-cd9e-4c8d-8fe7-17198ac92c2c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:25.336213 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f4e28a1a-cd9e-4c8d-8fe7-17198ac92c2c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:25.337402 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f4e28a1a-cd9e-4c8d-8fe7-17198ac92c2c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1736 microversion: 2.20 time: 0.692172 Aug 24 09:00:25.338639 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Getting quotas for project 6e585066a2274ef3b5a3ff29933e42ab. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:00:25.338996 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 303/601] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:24 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1736 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:25.343619 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-071e9d74-be3c-4e1d-914b-b0a41b936f3a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Action: 'create', calling method: .version_select at 0x7fb1417c34c0>, body: {"keypair": {"name": "tempest-keypair-640831116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrw2N1MnsR3A4HrtasZF8M0BC3OATaiQHL4Gp6trDwC69y6ZZOeQoAHgBg+vdcSHyjWXD6HwnzUZWpfhCi01/Ghs5aoERU/KHcC3v7XpFZ0S8NGQNgmeGIgI75QHrWyKQ=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:25.345116 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Getting quotas for user d5a1c7fe370643b08d6775190a155d86 and project 6e585066a2274ef3b5a3ff29933e42ab. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:00:25.362133 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-071e9d74-be3c-4e1d-914b-b0a41b936f3a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Getting quotas for project 7e6183eeb3ff43e79eccb5d7ad08c53c. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:00:25.362337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:00:25.364495 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:00:25.367284 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-071e9d74-be3c-4e1d-914b-b0a41b936f3a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Getting quotas for user bd0929f371e4442eb4eb6e12a96bbfc4 and project 7e6183eeb3ff43e79eccb5d7ad08c53c. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:00:25.394182 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-071e9d74-be3c-4e1d-914b-b0a41b936f3a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054212 Aug 24 09:00:25.394881 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 304/602] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 24 09:00:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:00:25.435124 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f8ffe7d7-7b27-4f72-9bcf-38fb0695279e tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.213097 Aug 24 09:00:25.436294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 299/603] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 09:00:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 09:00:25.452710 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-99204606-7fe3-4542-a670-636348168b94 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:25.454179 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-99204606-7fe3-4542-a670-636348168b94 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:25.551654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-99204606-7fe3-4542-a670-636348168b94 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:25.565748 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-99204606-7fe3-4542-a670-636348168b94 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1215 microversion: 2.1 time: 0.121769 Aug 24 09:00:25.566330 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 305/604] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:25 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1215 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:26.371951 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f93dcedb-3f35-43e2-ac95-65d59e814de8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:26.372677 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f93dcedb-3f35-43e2-ac95-65d59e814de8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:26.404583 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f93dcedb-3f35-43e2-ac95-65d59e814de8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:26.405129 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f93dcedb-3f35-43e2-ac95-65d59e814de8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:26.405618 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f93dcedb-3f35-43e2-ac95-65d59e814de8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:26.406508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f93dcedb-3f35-43e2-ac95-65d59e814de8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:26.406961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f93dcedb-3f35-43e2-ac95-65d59e814de8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:26.407652 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f93dcedb-3f35-43e2-ac95-65d59e814de8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:26.591019 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-58b0cce7-6d1f-4ef1-ad0f-1316ec11df91 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:26.592789 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-58b0cce7-6d1f-4ef1-ad0f-1316ec11df91 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:26.607745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b0cce7-6d1f-4ef1-ad0f-1316ec11df91 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:26.611073 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b0cce7-6d1f-4ef1-ad0f-1316ec11df91 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:26.611772 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b0cce7-6d1f-4ef1-ad0f-1316ec11df91 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:26.616928 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b0cce7-6d1f-4ef1-ad0f-1316ec11df91 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:26.617707 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b0cce7-6d1f-4ef1-ad0f-1316ec11df91 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:26.618283 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58b0cce7-6d1f-4ef1-ad0f-1316ec11df91 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:26.812405 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-58b0cce7-6d1f-4ef1-ad0f-1316ec11df91 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:26.823046 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f93dcedb-3f35-43e2-ac95-65d59e814de8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:26.823672 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-58b0cce7-6d1f-4ef1-ad0f-1316ec11df91 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1211 microversion: 2.1 time: 0.239407 Aug 24 09:00:26.824838 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 306/605] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:26 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1211 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:26.840600 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f93dcedb-3f35-43e2-ac95-65d59e814de8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:26.842270 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f93dcedb-3f35-43e2-ac95-65d59e814de8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:26.853596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f93dcedb-3f35-43e2-ac95-65d59e814de8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1736 microversion: 2.20 time: 0.485976 Aug 24 09:00:26.854184 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 300/606] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:26 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1736 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:27.851794 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ba38dbca-c57f-44a2-ba68-44b7e673ca0f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:27.852713 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ba38dbca-c57f-44a2-ba68-44b7e673ca0f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:27.864683 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba38dbca-c57f-44a2-ba68-44b7e673ca0f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:27.868177 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba38dbca-c57f-44a2-ba68-44b7e673ca0f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:27.873375 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba38dbca-c57f-44a2-ba68-44b7e673ca0f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:27.876859 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba38dbca-c57f-44a2-ba68-44b7e673ca0f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:27.880203 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba38dbca-c57f-44a2-ba68-44b7e673ca0f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:27.881183 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ba38dbca-c57f-44a2-ba68-44b7e673ca0f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:27.887040 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b7aabcd5-a4db-45a0-8783-39f694d6eb97 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:27.889842 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b7aabcd5-a4db-45a0-8783-39f694d6eb97 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:27.908518 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7aabcd5-a4db-45a0-8783-39f694d6eb97 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:27.911061 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7aabcd5-a4db-45a0-8783-39f694d6eb97 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:27.911951 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7aabcd5-a4db-45a0-8783-39f694d6eb97 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:27.913108 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7aabcd5-a4db-45a0-8783-39f694d6eb97 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:27.913750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7aabcd5-a4db-45a0-8783-39f694d6eb97 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:27.914361 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7aabcd5-a4db-45a0-8783-39f694d6eb97 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:28.158227 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ba38dbca-c57f-44a2-ba68-44b7e673ca0f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:28.186998 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ba38dbca-c57f-44a2-ba68-44b7e673ca0f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1273 microversion: 2.1 time: 0.342268 Aug 24 09:00:28.189361 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 307/607] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:27 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1273 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:28.362408 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b7aabcd5-a4db-45a0-8783-39f694d6eb97 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:28.390701 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b7aabcd5-a4db-45a0-8783-39f694d6eb97 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:28.399067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b7aabcd5-a4db-45a0-8783-39f694d6eb97 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:28.402668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b7aabcd5-a4db-45a0-8783-39f694d6eb97 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1736 microversion: 2.20 time: 0.525898 Aug 24 09:00:28.403202 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 301/608] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:27 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1736 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:28.743114 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-730426933", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42dddf86-1ed2-4180-bf35-64505e861ee8"}], "security_groups": [{"name": "tempest-securitygroup--1729485832"}], "key_name": "tempest-keypair-640831116", "user_data": "}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:29.213266 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d6c2d20c-9676-4a38-ac0a-4ee9e4d76404 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:29.215006 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d6c2d20c-9676-4a38-ac0a-4ee9e4d76404 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:29.236909 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6c2d20c-9676-4a38-ac0a-4ee9e4d76404 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:29.238820 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6c2d20c-9676-4a38-ac0a-4ee9e4d76404 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:29.240695 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6c2d20c-9676-4a38-ac0a-4ee9e4d76404 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:29.242443 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6c2d20c-9676-4a38-ac0a-4ee9e4d76404 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:29.243159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6c2d20c-9676-4a38-ac0a-4ee9e4d76404 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:29.244810 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d6c2d20c-9676-4a38-ac0a-4ee9e4d76404 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:29.775967 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d6c2d20c-9676-4a38-ac0a-4ee9e4d76404 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:29.811542 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d6c2d20c-9676-4a38-ac0a-4ee9e4d76404 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1315 microversion: 2.1 time: 0.604249 Aug 24 09:00:29.812467 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 302/609] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:29 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:29.819780 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b3c0acbb-7acd-469c-b220-bacf32647cbb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:29.820726 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b3c0acbb-7acd-469c-b220-bacf32647cbb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:29.828605 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3c0acbb-7acd-469c-b220-bacf32647cbb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:29.830522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3c0acbb-7acd-469c-b220-bacf32647cbb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:29.831144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3c0acbb-7acd-469c-b220-bacf32647cbb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:29.832033 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3c0acbb-7acd-469c-b220-bacf32647cbb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:29.836899 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3c0acbb-7acd-469c-b220-bacf32647cbb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:29.837594 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b3c0acbb-7acd-469c-b220-bacf32647cbb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:30.156178 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b3c0acbb-7acd-469c-b220-bacf32647cbb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:30.175836 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b3c0acbb-7acd-469c-b220-bacf32647cbb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:30.177436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b3c0acbb-7acd-469c-b220-bacf32647cbb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:30.178667 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b3c0acbb-7acd-469c-b220-bacf32647cbb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1736 microversion: 2.20 time: 0.365091 Aug 24 09:00:30.179235 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 303/610] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:29 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1736 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:30.442825 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-74fcbe95-d8a1-4e42-9b4d-0852b163dee1 req-333eacfb-c0ab-4851-8b3d-22aec5df4098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b6fff1d-5e5c-41c6-b601-9e141632478c", "tag": "457985d2-51d4-4966-afb4-606e16726c01"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:30.462976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-74fcbe95-d8a1-4e42-9b4d-0852b163dee1 req-333eacfb-c0ab-4851-8b3d-22aec5df4098 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:30.463516 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-74fcbe95-d8a1-4e42-9b4d-0852b163dee1 req-333eacfb-c0ab-4851-8b3d-22aec5df4098 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:30.463967 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-74fcbe95-d8a1-4e42-9b4d-0852b163dee1 req-333eacfb-c0ab-4851-8b3d-22aec5df4098 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:30.512863 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-74fcbe95-d8a1-4e42-9b4d-0852b163dee1 req-333eacfb-c0ab-4851-8b3d-22aec5df4098 service nova] Creating event network-changed:457985d2-51d4-4966-afb4-606e16726c01 for instance 3b6fff1d-5e5c-41c6-b601-9e141632478c on hv-cinder-83538 Aug 24 09:00:30.521608 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-74fcbe95-d8a1-4e42-9b4d-0852b163dee1 req-333eacfb-c0ab-4851-8b3d-22aec5df4098 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082907 Aug 24 09:00:30.522230 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 304/611] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:00:30.839355 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-84db68e0-b9c0-4b6f-87c8-891258e5c5d9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:30.840076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-84db68e0-b9c0-4b6f-87c8-891258e5c5d9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:30.855016 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84db68e0-b9c0-4b6f-87c8-891258e5c5d9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:30.855764 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84db68e0-b9c0-4b6f-87c8-891258e5c5d9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:30.856926 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84db68e0-b9c0-4b6f-87c8-891258e5c5d9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:30.857856 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84db68e0-b9c0-4b6f-87c8-891258e5c5d9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:30.858316 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84db68e0-b9c0-4b6f-87c8-891258e5c5d9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:30.858750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-84db68e0-b9c0-4b6f-87c8-891258e5c5d9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:31.123160 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-84db68e0-b9c0-4b6f-87c8-891258e5c5d9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:31.135354 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-84db68e0-b9c0-4b6f-87c8-891258e5c5d9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1315 microversion: 2.1 time: 0.300332 Aug 24 09:00:31.149341 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 305/612] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:30 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:31.210212 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ab89ffc5-aba6-421f-b6ea-aaeb56bb740c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:31.211207 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ab89ffc5-aba6-421f-b6ea-aaeb56bb740c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:31.219419 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab89ffc5-aba6-421f-b6ea-aaeb56bb740c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:31.221045 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab89ffc5-aba6-421f-b6ea-aaeb56bb740c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:31.221766 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab89ffc5-aba6-421f-b6ea-aaeb56bb740c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:31.222725 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab89ffc5-aba6-421f-b6ea-aaeb56bb740c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:31.223578 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab89ffc5-aba6-421f-b6ea-aaeb56bb740c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:31.224183 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ab89ffc5-aba6-421f-b6ea-aaeb56bb740c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:31.503684 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ab89ffc5-aba6-421f-b6ea-aaeb56bb740c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:31.514152 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ab89ffc5-aba6-421f-b6ea-aaeb56bb740c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:31.515662 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ab89ffc5-aba6-421f-b6ea-aaeb56bb740c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:31.516739 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ab89ffc5-aba6-421f-b6ea-aaeb56bb740c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1736 microversion: 2.20 time: 0.312823 Aug 24 09:00:31.535887 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 306/613] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:31 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1736 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:32.159402 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7a0e95a4-ab2c-4dbf-9d05-8821eee5cf0b tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:32.160400 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7a0e95a4-ab2c-4dbf-9d05-8821eee5cf0b tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:32.168329 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a0e95a4-ab2c-4dbf-9d05-8821eee5cf0b tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:32.169157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a0e95a4-ab2c-4dbf-9d05-8821eee5cf0b tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:32.169817 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a0e95a4-ab2c-4dbf-9d05-8821eee5cf0b tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:32.170900 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a0e95a4-ab2c-4dbf-9d05-8821eee5cf0b tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:32.171729 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a0e95a4-ab2c-4dbf-9d05-8821eee5cf0b tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:32.172480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a0e95a4-ab2c-4dbf-9d05-8821eee5cf0b tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:32.196324 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:32.343343 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7a0e95a4-ab2c-4dbf-9d05-8821eee5cf0b tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:32.352594 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7a0e95a4-ab2c-4dbf-9d05-8821eee5cf0b tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1315 microversion: 2.1 time: 0.197507 Aug 24 09:00:32.353696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 307/614] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:32 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:32.542622 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a4a13064-7115-4853-8a9a-751446e284d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:32.543373 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a4a13064-7115-4853-8a9a-751446e284d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:32.550023 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4a13064-7115-4853-8a9a-751446e284d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:32.550516 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4a13064-7115-4853-8a9a-751446e284d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:32.550951 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4a13064-7115-4853-8a9a-751446e284d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:32.551770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4a13064-7115-4853-8a9a-751446e284d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:32.552143 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4a13064-7115-4853-8a9a-751446e284d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:32.552575 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a4a13064-7115-4853-8a9a-751446e284d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:32.585729 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] validate_networks() for [('42dddf86-1ed2-4180-bf35-64505e861ee8', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:00:32.771524 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a4a13064-7115-4853-8a9a-751446e284d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:32.779971 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a4a13064-7115-4853-8a9a-751446e284d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:32.781527 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a4a13064-7115-4853-8a9a-751446e284d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:32.782700 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a4a13064-7115-4853-8a9a-751446e284d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1736 microversion: 2.20 time: 0.244006 Aug 24 09:00:32.783253 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 308/615] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:32 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1736 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:32.838960 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:33.035471 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:00:33.035998 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:00:33.036642 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:00:33.037149 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:00:33.037674 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:00:33.048504 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:33.049061 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:33.049673 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:33.050678 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:33.051207 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:33.051697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:33.070652 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Getting quotas for project 7e6183eeb3ff43e79eccb5d7ad08c53c. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:00:33.074751 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Getting quotas for user bd0929f371e4442eb4eb6e12a96bbfc4 and project 7e6183eeb3ff43e79eccb5d7ad08c53c. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:00:33.086302 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:00:33.089089 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:00:33.139001 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c05eb250-749c-4f63-87ea-295dbbf0e2e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.402601 Aug 24 09:00:33.139817 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 308/616] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 09:00:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 4404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:00:33.153991 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-feec0e4e-03db-4eba-9717-07cd647e6e9c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:33.154594 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-feec0e4e-03db-4eba-9717-07cd647e6e9c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:33.214969 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-feec0e4e-03db-4eba-9717-07cd647e6e9c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:33.223845 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-feec0e4e-03db-4eba-9717-07cd647e6e9c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1240 microversion: 2.1 time: 0.074202 Aug 24 09:00:33.224448 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 309/617] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:33 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:33.377291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c3e5af6c-444b-47cc-a373-44d5efbc5e90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:33.378000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c3e5af6c-444b-47cc-a373-44d5efbc5e90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:33.386943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e5af6c-444b-47cc-a373-44d5efbc5e90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:33.387452 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e5af6c-444b-47cc-a373-44d5efbc5e90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:33.387899 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e5af6c-444b-47cc-a373-44d5efbc5e90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:33.388658 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e5af6c-444b-47cc-a373-44d5efbc5e90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:33.389437 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e5af6c-444b-47cc-a373-44d5efbc5e90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:33.389541 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e5af6c-444b-47cc-a373-44d5efbc5e90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:33.533854 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c3e5af6c-444b-47cc-a373-44d5efbc5e90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:33.542110 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c3e5af6c-444b-47cc-a373-44d5efbc5e90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1315 microversion: 2.1 time: 0.171464 Aug 24 09:00:33.543038 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 309/618] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:33 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:33.806965 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fdd60e87-1808-436b-8793-aaa908b1224b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:33.807486 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fdd60e87-1808-436b-8793-aaa908b1224b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:33.814634 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fdd60e87-1808-436b-8793-aaa908b1224b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:33.815129 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fdd60e87-1808-436b-8793-aaa908b1224b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:33.815562 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fdd60e87-1808-436b-8793-aaa908b1224b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:33.816293 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fdd60e87-1808-436b-8793-aaa908b1224b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:33.816755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fdd60e87-1808-436b-8793-aaa908b1224b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:33.817180 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fdd60e87-1808-436b-8793-aaa908b1224b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:33.955729 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-fdd60e87-1808-436b-8793-aaa908b1224b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:33.964320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-fdd60e87-1808-436b-8793-aaa908b1224b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:33.965846 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-fdd60e87-1808-436b-8793-aaa908b1224b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:33.967300 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fdd60e87-1808-436b-8793-aaa908b1224b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1718 microversion: 2.20 time: 0.164469 Aug 24 09:00:33.967862 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 310/619] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:33 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1718 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:34.245494 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ff3d2354-4a7a-4bee-82fb-e89912ea9df7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:34.246112 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ff3d2354-4a7a-4bee-82fb-e89912ea9df7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:34.252857 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff3d2354-4a7a-4bee-82fb-e89912ea9df7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:34.253351 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff3d2354-4a7a-4bee-82fb-e89912ea9df7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:34.253789 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff3d2354-4a7a-4bee-82fb-e89912ea9df7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:34.254512 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff3d2354-4a7a-4bee-82fb-e89912ea9df7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:34.254965 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff3d2354-4a7a-4bee-82fb-e89912ea9df7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:34.255391 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff3d2354-4a7a-4bee-82fb-e89912ea9df7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:34.321288 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff3d2354-4a7a-4bee-82fb-e89912ea9df7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:34.329093 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ff3d2354-4a7a-4bee-82fb-e89912ea9df7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1244 microversion: 2.1 time: 0.087539 Aug 24 09:00:34.329672 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 310/620] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:34 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:34.564307 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b59c64bc-b564-4471-bc97-35776ab0876f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:34.564950 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b59c64bc-b564-4471-bc97-35776ab0876f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:34.572134 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59c64bc-b564-4471-bc97-35776ab0876f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:34.572536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59c64bc-b564-4471-bc97-35776ab0876f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:34.572982 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59c64bc-b564-4471-bc97-35776ab0876f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:34.573733 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59c64bc-b564-4471-bc97-35776ab0876f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:34.574209 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59c64bc-b564-4471-bc97-35776ab0876f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:34.574646 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b59c64bc-b564-4471-bc97-35776ab0876f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:34.737783 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b59c64bc-b564-4471-bc97-35776ab0876f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:34.748597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b59c64bc-b564-4471-bc97-35776ab0876f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1315 microversion: 2.1 time: 0.188359 Aug 24 09:00:34.749196 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 311/621] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:34 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:34.990130 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-af7f7564-ed14-4fcc-9749-37032ddf62d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:34.990737 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-af7f7564-ed14-4fcc-9749-37032ddf62d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:34.996902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af7f7564-ed14-4fcc-9749-37032ddf62d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:34.997395 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af7f7564-ed14-4fcc-9749-37032ddf62d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:34.997827 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af7f7564-ed14-4fcc-9749-37032ddf62d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:34.998531 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af7f7564-ed14-4fcc-9749-37032ddf62d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:34.998988 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af7f7564-ed14-4fcc-9749-37032ddf62d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:34.999415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-af7f7564-ed14-4fcc-9749-37032ddf62d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:35.154902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-af7f7564-ed14-4fcc-9749-37032ddf62d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:35.178559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-af7f7564-ed14-4fcc-9749-37032ddf62d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:35.181749 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-af7f7564-ed14-4fcc-9749-37032ddf62d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:35.187218 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-af7f7564-ed14-4fcc-9749-37032ddf62d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1718 microversion: 2.20 time: 0.197158 Aug 24 09:00:35.188609 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 311/622] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:34 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1718 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:35.350586 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5ae74af2-e9b1-488c-843c-9621724a6f99 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:35.351388 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5ae74af2-e9b1-488c-843c-9621724a6f99 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:35.353517 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:35.359191 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ae74af2-e9b1-488c-843c-9621724a6f99 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:35.359687 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ae74af2-e9b1-488c-843c-9621724a6f99 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:35.360155 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ae74af2-e9b1-488c-843c-9621724a6f99 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:35.361663 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ae74af2-e9b1-488c-843c-9621724a6f99 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:35.362230 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ae74af2-e9b1-488c-843c-9621724a6f99 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:35.362668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ae74af2-e9b1-488c-843c-9621724a6f99 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:35.434019 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5ae74af2-e9b1-488c-843c-9621724a6f99 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:35.443213 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5ae74af2-e9b1-488c-843c-9621724a6f99 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1244 microversion: 2.1 time: 0.096619 Aug 24 09:00:35.443925 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 312/623] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:35 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1244 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:35.770994 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a1b6d271-fe16-4603-bd5e-ae5e6e54cc9d tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:35.771645 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a1b6d271-fe16-4603-bd5e-ae5e6e54cc9d tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:35.778318 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1b6d271-fe16-4603-bd5e-ae5e6e54cc9d tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:35.778817 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1b6d271-fe16-4603-bd5e-ae5e6e54cc9d tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:35.779272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1b6d271-fe16-4603-bd5e-ae5e6e54cc9d tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:35.779995 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1b6d271-fe16-4603-bd5e-ae5e6e54cc9d tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:35.780745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1b6d271-fe16-4603-bd5e-ae5e6e54cc9d tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:35.781266 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a1b6d271-fe16-4603-bd5e-ae5e6e54cc9d tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:35.926383 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a1b6d271-fe16-4603-bd5e-ae5e6e54cc9d tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:35.934909 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a1b6d271-fe16-4603-bd5e-ae5e6e54cc9d tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1315 microversion: 2.1 time: 0.168949 Aug 24 09:00:35.935499 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 312/624] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:35 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:36.216551 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ec8d2894-1b78-44a8-b174-4108d59e6d76 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:36.217202 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ec8d2894-1b78-44a8-b174-4108d59e6d76 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:36.235217 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec8d2894-1b78-44a8-b174-4108d59e6d76 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:36.235720 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec8d2894-1b78-44a8-b174-4108d59e6d76 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:36.236726 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec8d2894-1b78-44a8-b174-4108d59e6d76 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:36.237447 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec8d2894-1b78-44a8-b174-4108d59e6d76 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:36.237908 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec8d2894-1b78-44a8-b174-4108d59e6d76 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:36.238335 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ec8d2894-1b78-44a8-b174-4108d59e6d76 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:36.384235 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ec8d2894-1b78-44a8-b174-4108d59e6d76 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:36.393765 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ec8d2894-1b78-44a8-b174-4108d59e6d76 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:36.395304 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ec8d2894-1b78-44a8-b174-4108d59e6d76 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:36.396544 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ec8d2894-1b78-44a8-b174-4108d59e6d76 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1718 microversion: 2.20 time: 0.185626 Aug 24 09:00:36.397111 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 313/625] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:36 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1718 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:36.465807 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c4adf0dc-1682-45a4-8f58-218fbc7dc855 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:36.466313 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c4adf0dc-1682-45a4-8f58-218fbc7dc855 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:36.473351 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4adf0dc-1682-45a4-8f58-218fbc7dc855 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:36.473854 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4adf0dc-1682-45a4-8f58-218fbc7dc855 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:36.474302 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4adf0dc-1682-45a4-8f58-218fbc7dc855 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:36.475032 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4adf0dc-1682-45a4-8f58-218fbc7dc855 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:36.475497 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4adf0dc-1682-45a4-8f58-218fbc7dc855 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:36.476021 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4adf0dc-1682-45a4-8f58-218fbc7dc855 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:36.545425 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c4adf0dc-1682-45a4-8f58-218fbc7dc855 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:36.549527 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:36.554648 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c4adf0dc-1682-45a4-8f58-218fbc7dc855 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1244 microversion: 2.1 time: 0.092808 Aug 24 09:00:36.555241 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 313/626] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:36 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:36.958223 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0c30129c-c3d5-489a-8ea6-85be2990296c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:36.958864 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0c30129c-c3d5-489a-8ea6-85be2990296c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:36.965186 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c30129c-c3d5-489a-8ea6-85be2990296c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:36.965685 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c30129c-c3d5-489a-8ea6-85be2990296c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:36.966129 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c30129c-c3d5-489a-8ea6-85be2990296c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:36.966843 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c30129c-c3d5-489a-8ea6-85be2990296c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:36.967308 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c30129c-c3d5-489a-8ea6-85be2990296c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:36.967737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0c30129c-c3d5-489a-8ea6-85be2990296c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:37.111736 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0c30129c-c3d5-489a-8ea6-85be2990296c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:37.120343 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0c30129c-c3d5-489a-8ea6-85be2990296c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1315 microversion: 2.1 time: 0.167567 Aug 24 09:00:37.128242 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 314/627] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:36 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:37.149599 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-c6a3b212-da1d-4271-8573-756170b92372 req-564c829c-6e67-422c-a784-9b5223acdb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4866e8f4-ddfe-4cee-8bcc-5db7372926f5", "name": "network-vif-unplugged", "status": "completed", "tag": "4e1f25c9-676d-433c-8c1b-ae79e13a1625"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:37.161118 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c6a3b212-da1d-4271-8573-756170b92372 req-564c829c-6e67-422c-a784-9b5223acdb84 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:37.161659 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c6a3b212-da1d-4271-8573-756170b92372 req-564c829c-6e67-422c-a784-9b5223acdb84 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:37.162106 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-c6a3b212-da1d-4271-8573-756170b92372 req-564c829c-6e67-422c-a784-9b5223acdb84 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:37.176483 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-c6a3b212-da1d-4271-8573-756170b92372 req-564c829c-6e67-422c-a784-9b5223acdb84 service nova] Creating event network-vif-unplugged:4e1f25c9-676d-433c-8c1b-ae79e13a1625 for instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 on hv-cinder-83538 Aug 24 09:00:37.182328 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-c6a3b212-da1d-4271-8573-756170b92372 req-564c829c-6e67-422c-a784-9b5223acdb84 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036516 Aug 24 09:00:37.183235 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 314/628] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:00:37.423850 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f17055b1-b6df-43ad-a2af-8ba2b90249d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:37.425259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f17055b1-b6df-43ad-a2af-8ba2b90249d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:37.433120 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f17055b1-b6df-43ad-a2af-8ba2b90249d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:37.434231 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f17055b1-b6df-43ad-a2af-8ba2b90249d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:37.434682 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f17055b1-b6df-43ad-a2af-8ba2b90249d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:37.435407 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f17055b1-b6df-43ad-a2af-8ba2b90249d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:37.435870 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f17055b1-b6df-43ad-a2af-8ba2b90249d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:37.436340 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f17055b1-b6df-43ad-a2af-8ba2b90249d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:37.590290 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-425778f1-40c8-4116-912b-19e29987b6a9 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:37.597995 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-425778f1-40c8-4116-912b-19e29987b6a9 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:37.608319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-425778f1-40c8-4116-912b-19e29987b6a9 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:37.608823 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-425778f1-40c8-4116-912b-19e29987b6a9 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:37.609333 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-425778f1-40c8-4116-912b-19e29987b6a9 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:37.610236 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-425778f1-40c8-4116-912b-19e29987b6a9 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:37.610708 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-425778f1-40c8-4116-912b-19e29987b6a9 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:37.611779 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-425778f1-40c8-4116-912b-19e29987b6a9 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:37.709102 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-425778f1-40c8-4116-912b-19e29987b6a9 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:37.721198 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-425778f1-40c8-4116-912b-19e29987b6a9 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1292 microversion: 2.1 time: 0.142664 Aug 24 09:00:37.721198 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 315/629] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:37 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1292 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:37.739458 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f17055b1-b6df-43ad-a2af-8ba2b90249d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:37.748512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f17055b1-b6df-43ad-a2af-8ba2b90249d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:37.749995 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f17055b1-b6df-43ad-a2af-8ba2b90249d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:37.751200 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f17055b1-b6df-43ad-a2af-8ba2b90249d4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1718 microversion: 2.20 time: 0.331620 Aug 24 09:00:37.753246 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 315/630] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:37 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1718 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:38.141753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c3e4eb98-b01f-407b-9c91-031b2898d242 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:38.143695 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c3e4eb98-b01f-407b-9c91-031b2898d242 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:38.150634 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e4eb98-b01f-407b-9c91-031b2898d242 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:38.152016 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e4eb98-b01f-407b-9c91-031b2898d242 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:38.152433 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e4eb98-b01f-407b-9c91-031b2898d242 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:38.153094 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e4eb98-b01f-407b-9c91-031b2898d242 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:38.154046 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e4eb98-b01f-407b-9c91-031b2898d242 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:38.154429 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3e4eb98-b01f-407b-9c91-031b2898d242 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:38.750211 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e1617559-f5d4-4ceb-beac-921090665983 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:38.750914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e1617559-f5d4-4ceb-beac-921090665983 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:38.753148 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:38.758484 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1617559-f5d4-4ceb-beac-921090665983 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:38.759065 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1617559-f5d4-4ceb-beac-921090665983 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:38.759831 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1617559-f5d4-4ceb-beac-921090665983 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:38.760649 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1617559-f5d4-4ceb-beac-921090665983 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:38.761236 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1617559-f5d4-4ceb-beac-921090665983 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:38.761732 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e1617559-f5d4-4ceb-beac-921090665983 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:38.929409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e1617559-f5d4-4ceb-beac-921090665983 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:38.937063 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e1617559-f5d4-4ceb-beac-921090665983 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1298 microversion: 2.1 time: 0.197105 Aug 24 09:00:38.937845 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 316/631] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:38 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1298 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:38.942509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-101eddc2-4ed4-4a06-8499-786512448ef0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:38.943105 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-101eddc2-4ed4-4a06-8499-786512448ef0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:38.948966 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-101eddc2-4ed4-4a06-8499-786512448ef0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:38.949423 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-101eddc2-4ed4-4a06-8499-786512448ef0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:38.949856 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-101eddc2-4ed4-4a06-8499-786512448ef0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:38.951101 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-101eddc2-4ed4-4a06-8499-786512448ef0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:38.951101 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-101eddc2-4ed4-4a06-8499-786512448ef0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:38.951444 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-101eddc2-4ed4-4a06-8499-786512448ef0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:38.953363 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c3e4eb98-b01f-407b-9c91-031b2898d242 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:38.962002 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c3e4eb98-b01f-407b-9c91-031b2898d242 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1315 microversion: 2.1 time: 0.824442 Aug 24 09:00:38.962817 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 316/632] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:38 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1315 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:39.363241 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-101eddc2-4ed4-4a06-8499-786512448ef0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:39.372781 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-101eddc2-4ed4-4a06-8499-786512448ef0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:39.374651 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-101eddc2-4ed4-4a06-8499-786512448ef0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:39.376261 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-101eddc2-4ed4-4a06-8499-786512448ef0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1718 microversion: 2.20 time: 0.437650 Aug 24 09:00:39.388971 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 317/633] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:38 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1718 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:39.960578 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b58e17b9-b1b4-44e6-952d-2a46d2dbded6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:39.961283 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b58e17b9-b1b4-44e6-952d-2a46d2dbded6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:39.967692 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b58e17b9-b1b4-44e6-952d-2a46d2dbded6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:39.968222 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b58e17b9-b1b4-44e6-952d-2a46d2dbded6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:39.968813 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b58e17b9-b1b4-44e6-952d-2a46d2dbded6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:39.969545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b58e17b9-b1b4-44e6-952d-2a46d2dbded6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:39.970004 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b58e17b9-b1b4-44e6-952d-2a46d2dbded6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:39.970470 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b58e17b9-b1b4-44e6-952d-2a46d2dbded6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:39.989683 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8268a281-e060-4d69-89ac-4e96acdb4d90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:39.991150 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8268a281-e060-4d69-89ac-4e96acdb4d90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:39.998131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8268a281-e060-4d69-89ac-4e96acdb4d90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:39.998621 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8268a281-e060-4d69-89ac-4e96acdb4d90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:39.999259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8268a281-e060-4d69-89ac-4e96acdb4d90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:39.999972 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8268a281-e060-4d69-89ac-4e96acdb4d90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:40.000451 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8268a281-e060-4d69-89ac-4e96acdb4d90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:40.000878 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8268a281-e060-4d69-89ac-4e96acdb4d90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:40.198466 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b58e17b9-b1b4-44e6-952d-2a46d2dbded6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:40.207184 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8268a281-e060-4d69-89ac-4e96acdb4d90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:40.208050 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b58e17b9-b1b4-44e6-952d-2a46d2dbded6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.251721 Aug 24 09:00:40.208798 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 317/634] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:39 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:40.216207 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8268a281-e060-4d69-89ac-4e96acdb4d90 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1315 microversion: 2.1 time: 0.235054 Aug 24 09:00:40.216812 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 318/635] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:39 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:40.402265 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8f5947e8-8e84-4d6b-b359-56e39a898af7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:40.402883 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8f5947e8-8e84-4d6b-b359-56e39a898af7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:40.409047 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f5947e8-8e84-4d6b-b359-56e39a898af7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:40.409541 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f5947e8-8e84-4d6b-b359-56e39a898af7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:40.409983 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f5947e8-8e84-4d6b-b359-56e39a898af7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:40.410699 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f5947e8-8e84-4d6b-b359-56e39a898af7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:40.411151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f5947e8-8e84-4d6b-b359-56e39a898af7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:40.411585 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8f5947e8-8e84-4d6b-b359-56e39a898af7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:40.553604 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8f5947e8-8e84-4d6b-b359-56e39a898af7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:40.562004 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8f5947e8-8e84-4d6b-b359-56e39a898af7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:40.563523 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8f5947e8-8e84-4d6b-b359-56e39a898af7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:40.565495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8f5947e8-8e84-4d6b-b359-56e39a898af7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1718 microversion: 2.20 time: 0.167121 Aug 24 09:00:40.566058 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 318/636] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:40 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1718 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:41.229360 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a87a1ffa-a882-45da-a338-e5b68cc32c33 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:41.230155 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a87a1ffa-a882-45da-a338-e5b68cc32c33 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:41.237986 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e20b69ff-e75a-469e-832d-25258f255db9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:41.238637 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a87a1ffa-a882-45da-a338-e5b68cc32c33 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:41.238809 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e20b69ff-e75a-469e-832d-25258f255db9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:41.239248 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a87a1ffa-a882-45da-a338-e5b68cc32c33 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:41.239692 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a87a1ffa-a882-45da-a338-e5b68cc32c33 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:41.240432 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a87a1ffa-a882-45da-a338-e5b68cc32c33 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:41.240984 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a87a1ffa-a882-45da-a338-e5b68cc32c33 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:41.241617 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a87a1ffa-a882-45da-a338-e5b68cc32c33 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:41.245670 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e20b69ff-e75a-469e-832d-25258f255db9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:41.246178 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e20b69ff-e75a-469e-832d-25258f255db9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:41.247274 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e20b69ff-e75a-469e-832d-25258f255db9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:41.248237 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e20b69ff-e75a-469e-832d-25258f255db9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:41.248897 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e20b69ff-e75a-469e-832d-25258f255db9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:41.249333 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e20b69ff-e75a-469e-832d-25258f255db9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:41.568015 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e20b69ff-e75a-469e-832d-25258f255db9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:41.571251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a87a1ffa-a882-45da-a338-e5b68cc32c33 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:41.579687 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a87a1ffa-a882-45da-a338-e5b68cc32c33 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.354096 Aug 24 09:00:41.592533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 319/637] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:41 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:41.597555 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e20b69ff-e75a-469e-832d-25258f255db9 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1315 microversion: 2.1 time: 0.363618 Aug 24 09:00:41.599643 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f52d9a44-0d14-4d03-8094-034ad60623ac tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:41.600574 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f52d9a44-0d14-4d03-8094-034ad60623ac tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:41.607317 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f52d9a44-0d14-4d03-8094-034ad60623ac tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:41.608078 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f52d9a44-0d14-4d03-8094-034ad60623ac tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:41.608747 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f52d9a44-0d14-4d03-8094-034ad60623ac tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:41.609667 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f52d9a44-0d14-4d03-8094-034ad60623ac tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:41.610308 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f52d9a44-0d14-4d03-8094-034ad60623ac tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:41.610927 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f52d9a44-0d14-4d03-8094-034ad60623ac tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:41.618784 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 319/638] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:41 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:41.745840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-955d2d03-9758-4d97-be49-7a14f4af63e0 req-f7991877-77e8-4314-b044-28b76f68fad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b6fff1d-5e5c-41c6-b601-9e141632478c", "name": "network-vif-plugged", "status": "completed", "tag": "457985d2-51d4-4966-afb4-606e16726c01"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:41.779451 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-955d2d03-9758-4d97-be49-7a14f4af63e0 req-f7991877-77e8-4314-b044-28b76f68fad4 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:41.780830 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-955d2d03-9758-4d97-be49-7a14f4af63e0 req-f7991877-77e8-4314-b044-28b76f68fad4 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:41.782625 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-955d2d03-9758-4d97-be49-7a14f4af63e0 req-f7991877-77e8-4314-b044-28b76f68fad4 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:41.811224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-955d2d03-9758-4d97-be49-7a14f4af63e0 req-f7991877-77e8-4314-b044-28b76f68fad4 service nova] Creating event network-vif-plugged:457985d2-51d4-4966-afb4-606e16726c01 for instance 3b6fff1d-5e5c-41c6-b601-9e141632478c on hv-cinder-83538 Aug 24 09:00:41.830082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-955d2d03-9758-4d97-be49-7a14f4af63e0 req-f7991877-77e8-4314-b044-28b76f68fad4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098200 Aug 24 09:00:41.832440 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 320/639] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:00:41.933118 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f52d9a44-0d14-4d03-8094-034ad60623ac tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:41.947072 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f52d9a44-0d14-4d03-8094-034ad60623ac tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:41.949765 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f52d9a44-0d14-4d03-8094-034ad60623ac tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:41.951012 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f52d9a44-0d14-4d03-8094-034ad60623ac tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1718 microversion: 2.20 time: 0.357385 Aug 24 09:00:41.957781 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 320/640] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:41 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1718 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:42.113584 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-0feded64-58be-4b5b-be76-976897903e94 req-a4a3138e-43bc-435b-a5ca-11fec002a36c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08718641-a85b-4edf-9dc2-c8e30724b3b5", "tag": "8c8399ef-892b-41d4-b7ba-affd23dd9979"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:42.124691 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0feded64-58be-4b5b-be76-976897903e94 req-a4a3138e-43bc-435b-a5ca-11fec002a36c service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:42.125350 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0feded64-58be-4b5b-be76-976897903e94 req-a4a3138e-43bc-435b-a5ca-11fec002a36c service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:42.125898 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0feded64-58be-4b5b-be76-976897903e94 req-a4a3138e-43bc-435b-a5ca-11fec002a36c service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:42.141483 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-0feded64-58be-4b5b-be76-976897903e94 req-a4a3138e-43bc-435b-a5ca-11fec002a36c service nova] Creating event network-changed:8c8399ef-892b-41d4-b7ba-affd23dd9979 for instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 on hv-cinder-83538 Aug 24 09:00:42.148479 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-0feded64-58be-4b5b-be76-976897903e94 req-a4a3138e-43bc-435b-a5ca-11fec002a36c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040593 Aug 24 09:00:42.149383 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 321/641] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:00:42.606437 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d2ba9de1-7873-4699-9626-b62ad54291dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:42.608474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d2ba9de1-7873-4699-9626-b62ad54291dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:42.618367 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2ba9de1-7873-4699-9626-b62ad54291dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:42.619309 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2ba9de1-7873-4699-9626-b62ad54291dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:42.619886 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2ba9de1-7873-4699-9626-b62ad54291dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:42.620834 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2ba9de1-7873-4699-9626-b62ad54291dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:42.621551 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2ba9de1-7873-4699-9626-b62ad54291dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:42.622180 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2ba9de1-7873-4699-9626-b62ad54291dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:42.658034 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a3a7001-4da6-4684-bd36-a746f067122c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:42.658835 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6a3a7001-4da6-4684-bd36-a746f067122c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:42.671416 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a3a7001-4da6-4684-bd36-a746f067122c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:42.672511 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a3a7001-4da6-4684-bd36-a746f067122c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:42.673381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a3a7001-4da6-4684-bd36-a746f067122c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:42.675831 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a3a7001-4da6-4684-bd36-a746f067122c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:42.676768 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a3a7001-4da6-4684-bd36-a746f067122c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:42.677599 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a3a7001-4da6-4684-bd36-a746f067122c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:43.062108 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:43.082290 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=12 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:43.220897 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=12 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:43.294365 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d2ba9de1-7873-4699-9626-b62ad54291dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:43.303315 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d2ba9de1-7873-4699-9626-b62ad54291dc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.702584 Aug 24 09:00:43.304584 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 321/642] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:42 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:43.309608 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7a9f4a2f-d5cc-4101-b114-db443f8d9dd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:43.310522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7a9f4a2f-d5cc-4101-b114-db443f8d9dd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:43.318034 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a9f4a2f-d5cc-4101-b114-db443f8d9dd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:43.318800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a9f4a2f-d5cc-4101-b114-db443f8d9dd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:43.319410 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a9f4a2f-d5cc-4101-b114-db443f8d9dd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:43.320468 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a9f4a2f-d5cc-4101-b114-db443f8d9dd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:43.321098 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a9f4a2f-d5cc-4101-b114-db443f8d9dd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:43.321683 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a9f4a2f-d5cc-4101-b114-db443f8d9dd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:43.325825 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6a3a7001-4da6-4684-bd36-a746f067122c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:43.338230 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6a3a7001-4da6-4684-bd36-a746f067122c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1315 microversion: 2.1 time: 0.687461 Aug 24 09:00:43.338835 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 322/643] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:42 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:43.517850 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7a9f4a2f-d5cc-4101-b114-db443f8d9dd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:43.529141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7a9f4a2f-d5cc-4101-b114-db443f8d9dd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:43.530833 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7a9f4a2f-d5cc-4101-b114-db443f8d9dd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:43.532173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7a9f4a2f-d5cc-4101-b114-db443f8d9dd5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1661 microversion: 2.20 time: 0.226565 Aug 24 09:00:43.532760 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 322/644] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:43 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1661 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:43.577744 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d5daac40-1d9e-4024-9697-cede0656e8fd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8e9dd4c-8bb7-44a4-8933-6264b50968aa"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:43.582055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d5daac40-1d9e-4024-9697-cede0656e8fd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:43.593465 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5daac40-1d9e-4024-9697-cede0656e8fd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:43.594348 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5daac40-1d9e-4024-9697-cede0656e8fd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:43.595145 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5daac40-1d9e-4024-9697-cede0656e8fd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:43.596517 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5daac40-1d9e-4024-9697-cede0656e8fd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:43.597596 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5daac40-1d9e-4024-9697-cede0656e8fd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:43.598236 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5daac40-1d9e-4024-9697-cede0656e8fd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:43.960572 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d5daac40-1d9e-4024-9697-cede0656e8fd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "POST /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.390617 Aug 24 09:00:43.961345 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 323/645] 10.222.0.67 () {62 vars in 1364 bytes} [Wed Aug 24 09:00:43 2022] POST /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/os-volume_attachments => generated 188 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:00:44.110822 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6ff514d4-4592-4cf4-b3ed-a2a1ad9343a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:44.111587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6ff514d4-4592-4cf4-b3ed-a2a1ad9343a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:44.119048 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ff514d4-4592-4cf4-b3ed-a2a1ad9343a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:44.119594 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ff514d4-4592-4cf4-b3ed-a2a1ad9343a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:44.120244 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ff514d4-4592-4cf4-b3ed-a2a1ad9343a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:44.121019 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ff514d4-4592-4cf4-b3ed-a2a1ad9343a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:44.121523 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ff514d4-4592-4cf4-b3ed-a2a1ad9343a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:44.121996 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6ff514d4-4592-4cf4-b3ed-a2a1ad9343a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:44.175060 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6ff514d4-4592-4cf4-b3ed-a2a1ad9343a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120543) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 09:00:44.254382 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6ff514d4-4592-4cf4-b3ed-a2a1ad9343a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "POST /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/action" status: 202 len: 0 microversion: 2.20 time: 0.147605 Aug 24 09:00:44.255031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 323/646] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 24 09:00:44 2022] POST /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:00:44.267799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0b8f58dd-bcce-48f8-9aaa-9288784ea8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:44.268969 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0b8f58dd-bcce-48f8-9aaa-9288784ea8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:44.281583 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8f58dd-bcce-48f8-9aaa-9288784ea8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:44.282497 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8f58dd-bcce-48f8-9aaa-9288784ea8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:44.283820 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8f58dd-bcce-48f8-9aaa-9288784ea8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:44.285217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8f58dd-bcce-48f8-9aaa-9288784ea8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:44.286054 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8f58dd-bcce-48f8-9aaa-9288784ea8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:44.286828 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0b8f58dd-bcce-48f8-9aaa-9288784ea8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:44.341815 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f87d1498-af95-4bcc-8734-1f85a4a614ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:44.342839 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f87d1498-af95-4bcc-8734-1f85a4a614ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:44.352697 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f87d1498-af95-4bcc-8734-1f85a4a614ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:44.353375 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f87d1498-af95-4bcc-8734-1f85a4a614ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:44.354060 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f87d1498-af95-4bcc-8734-1f85a4a614ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:44.355176 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f87d1498-af95-4bcc-8734-1f85a4a614ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:44.356248 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f87d1498-af95-4bcc-8734-1f85a4a614ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:44.357348 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f87d1498-af95-4bcc-8734-1f85a4a614ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:44.364750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:44.563517 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0b8f58dd-bcce-48f8-9aaa-9288784ea8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:44.574528 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0b8f58dd-bcce-48f8-9aaa-9288784ea8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:44.576388 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0b8f58dd-bcce-48f8-9aaa-9288784ea8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:44.577632 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0b8f58dd-bcce-48f8-9aaa-9288784ea8c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1747 microversion: 2.20 time: 0.317669 Aug 24 09:00:44.584187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 324/647] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:44 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1747 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:44.586417 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-44737eda-4b65-47a1-b3e3-5b7105ec5542 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:44.586652 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-44737eda-4b65-47a1-b3e3-5b7105ec5542 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:44.599643 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44737eda-4b65-47a1-b3e3-5b7105ec5542 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:44.600176 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44737eda-4b65-47a1-b3e3-5b7105ec5542 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:44.600623 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44737eda-4b65-47a1-b3e3-5b7105ec5542 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:44.601350 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44737eda-4b65-47a1-b3e3-5b7105ec5542 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:44.601973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44737eda-4b65-47a1-b3e3-5b7105ec5542 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:44.602403 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-44737eda-4b65-47a1-b3e3-5b7105ec5542 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:44.682937 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f87d1498-af95-4bcc-8734-1f85a4a614ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:44.692142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f87d1498-af95-4bcc-8734-1f85a4a614ef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.357355 Aug 24 09:00:44.692851 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 324/648] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:44 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:44.907628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-44737eda-4b65-47a1-b3e3-5b7105ec5542 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:44.918616 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-44737eda-4b65-47a1-b3e3-5b7105ec5542 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1315 microversion: 2.1 time: 0.339303 Aug 24 09:00:44.919515 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 325/649] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:44 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:45.725840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bd8dcc71-6c98-4911-8e72-3e20408b0cf8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:45.726527 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bd8dcc71-6c98-4911-8e72-3e20408b0cf8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:45.732897 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd8dcc71-6c98-4911-8e72-3e20408b0cf8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:45.733428 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd8dcc71-6c98-4911-8e72-3e20408b0cf8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:45.735129 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fd8ab396-5e01-46cb-b8d8-fe2d72d2b4ae tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:45.736679 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fd8ab396-5e01-46cb-b8d8-fe2d72d2b4ae tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:45.737880 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd8dcc71-6c98-4911-8e72-3e20408b0cf8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:45.739319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd8dcc71-6c98-4911-8e72-3e20408b0cf8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:45.739915 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd8dcc71-6c98-4911-8e72-3e20408b0cf8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:45.740983 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd8dcc71-6c98-4911-8e72-3e20408b0cf8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:45.744297 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8ab396-5e01-46cb-b8d8-fe2d72d2b4ae tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:45.744889 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8ab396-5e01-46cb-b8d8-fe2d72d2b4ae tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:45.745511 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8ab396-5e01-46cb-b8d8-fe2d72d2b4ae tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:45.746562 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8ab396-5e01-46cb-b8d8-fe2d72d2b4ae tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:45.747147 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8ab396-5e01-46cb-b8d8-fe2d72d2b4ae tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:45.747690 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fd8ab396-5e01-46cb-b8d8-fe2d72d2b4ae tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:46.035435 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-bd8dcc71-6c98-4911-8e72-3e20408b0cf8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:46.044911 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bd8dcc71-6c98-4911-8e72-3e20408b0cf8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.323190 Aug 24 09:00:46.045530 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 326/650] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:45 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:46.046203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-fd8ab396-5e01-46cb-b8d8-fe2d72d2b4ae tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:46.050962 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-953164b6-932c-420c-84a4-b16bd0116e54 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:46.051588 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-953164b6-932c-420c-84a4-b16bd0116e54 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:46.058201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-953164b6-932c-420c-84a4-b16bd0116e54 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:46.058954 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-953164b6-932c-420c-84a4-b16bd0116e54 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:46.059400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-953164b6-932c-420c-84a4-b16bd0116e54 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:46.060768 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-953164b6-932c-420c-84a4-b16bd0116e54 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:46.061329 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-953164b6-932c-420c-84a4-b16bd0116e54 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:46.061764 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-953164b6-932c-420c-84a4-b16bd0116e54 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:46.062998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-fd8ab396-5e01-46cb-b8d8-fe2d72d2b4ae tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:46.066408 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-fd8ab396-5e01-46cb-b8d8-fe2d72d2b4ae tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:46.068805 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fd8ab396-5e01-46cb-b8d8-fe2d72d2b4ae tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1747 microversion: 2.20 time: 0.470052 Aug 24 09:00:46.069838 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 325/651] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:45 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1747 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:46.218374 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-953164b6-932c-420c-84a4-b16bd0116e54 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:46.227569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-953164b6-932c-420c-84a4-b16bd0116e54 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1465 microversion: 2.1 time: 0.180852 Aug 24 09:00:46.228198 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 327/652] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:46 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1465 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:46.276846 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c7fafdac-3720-49b3-be43-e093bc504f2c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:46.277430 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c7fafdac-3720-49b3-be43-e093bc504f2c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:46.284086 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7fafdac-3720-49b3-be43-e093bc504f2c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:46.284725 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7fafdac-3720-49b3-be43-e093bc504f2c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:46.285221 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7fafdac-3720-49b3-be43-e093bc504f2c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:46.285958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7fafdac-3720-49b3-be43-e093bc504f2c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:46.286415 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7fafdac-3720-49b3-be43-e093bc504f2c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:46.286839 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c7fafdac-3720-49b3-be43-e093bc504f2c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:46.315711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c7fafdac-3720-49b3-be43-e093bc504f2c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:00:46.405254 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c7fafdac-3720-49b3-be43-e093bc504f2c tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 204 len: 0 microversion: 2.1 time: 0.132544 Aug 24 09:00:46.406006 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 326/653] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:00:46 2022] DELETE /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:00:46.415728 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2a56aba6-c847-438a-9bc6-63f7eeac04f8 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:46.416374 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2a56aba6-c847-438a-9bc6-63f7eeac04f8 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:46.422766 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a56aba6-c847-438a-9bc6-63f7eeac04f8 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:46.423263 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a56aba6-c847-438a-9bc6-63f7eeac04f8 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:46.423709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a56aba6-c847-438a-9bc6-63f7eeac04f8 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:46.424540 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a56aba6-c847-438a-9bc6-63f7eeac04f8 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:46.425012 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a56aba6-c847-438a-9bc6-63f7eeac04f8 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:46.425439 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a56aba6-c847-438a-9bc6-63f7eeac04f8 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:46.582286 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2a56aba6-c847-438a-9bc6-63f7eeac04f8 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:46.591369 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2a56aba6-c847-438a-9bc6-63f7eeac04f8 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1471 microversion: 2.1 time: 0.179646 Aug 24 09:00:46.591953 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 328/654] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:46 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:47.072665 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5fee9842-09c7-4f18-975f-4bc1eb684e24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:47.073366 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5fee9842-09c7-4f18-975f-4bc1eb684e24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:47.080948 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fee9842-09c7-4f18-975f-4bc1eb684e24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:47.081443 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fee9842-09c7-4f18-975f-4bc1eb684e24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:47.081875 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fee9842-09c7-4f18-975f-4bc1eb684e24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:47.082581 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fee9842-09c7-4f18-975f-4bc1eb684e24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:47.083031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fee9842-09c7-4f18-975f-4bc1eb684e24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:47.083446 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5fee9842-09c7-4f18-975f-4bc1eb684e24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:47.098088 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-85e286f2-f2ad-4dc9-a1cb-fd5f5a8ee7da tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:47.099059 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-85e286f2-f2ad-4dc9-a1cb-fd5f5a8ee7da tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:47.105474 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85e286f2-f2ad-4dc9-a1cb-fd5f5a8ee7da tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:47.105980 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85e286f2-f2ad-4dc9-a1cb-fd5f5a8ee7da tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:47.106558 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85e286f2-f2ad-4dc9-a1cb-fd5f5a8ee7da tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:47.107353 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85e286f2-f2ad-4dc9-a1cb-fd5f5a8ee7da tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:47.107763 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85e286f2-f2ad-4dc9-a1cb-fd5f5a8ee7da tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:47.108234 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85e286f2-f2ad-4dc9-a1cb-fd5f5a8ee7da tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:47.323405 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5fee9842-09c7-4f18-975f-4bc1eb684e24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:47.338482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5fee9842-09c7-4f18-975f-4bc1eb684e24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.269671 Aug 24 09:00:47.339514 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 327/655] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:47 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:47.341705 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-85e286f2-f2ad-4dc9-a1cb-fd5f5a8ee7da tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:47.346439 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:47.366509 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-85e286f2-f2ad-4dc9-a1cb-fd5f5a8ee7da tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:47.368077 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-85e286f2-f2ad-4dc9-a1cb-fd5f5a8ee7da tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:47.369406 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-85e286f2-f2ad-4dc9-a1cb-fd5f5a8ee7da tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1747 microversion: 2.20 time: 0.279412 Aug 24 09:00:47.370014 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 329/656] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:47 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1747 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:47.617182 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d1c3579c-1b1d-4d8e-b04c-6b33d9502e29 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:47.617698 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d1c3579c-1b1d-4d8e-b04c-6b33d9502e29 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:47.623743 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1c3579c-1b1d-4d8e-b04c-6b33d9502e29 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:47.624272 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1c3579c-1b1d-4d8e-b04c-6b33d9502e29 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:47.624709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1c3579c-1b1d-4d8e-b04c-6b33d9502e29 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:47.625408 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1c3579c-1b1d-4d8e-b04c-6b33d9502e29 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:47.625867 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1c3579c-1b1d-4d8e-b04c-6b33d9502e29 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:47.626293 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d1c3579c-1b1d-4d8e-b04c-6b33d9502e29 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:47.780528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d1c3579c-1b1d-4d8e-b04c-6b33d9502e29 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:47.789136 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d1c3579c-1b1d-4d8e-b04c-6b33d9502e29 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1471 microversion: 2.1 time: 0.175935 Aug 24 09:00:47.789720 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 328/657] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:47 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:48.374953 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5c8dcfb1-6cb7-4fdc-8ded-a6709984583d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:48.375522 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5c8dcfb1-6cb7-4fdc-8ded-a6709984583d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:48.383889 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c8dcfb1-6cb7-4fdc-8ded-a6709984583d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:48.384427 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c8dcfb1-6cb7-4fdc-8ded-a6709984583d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:48.384906 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c8dcfb1-6cb7-4fdc-8ded-a6709984583d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:48.385900 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c8dcfb1-6cb7-4fdc-8ded-a6709984583d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:48.386367 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c8dcfb1-6cb7-4fdc-8ded-a6709984583d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:48.386793 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c8dcfb1-6cb7-4fdc-8ded-a6709984583d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:48.395486 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-98041914-4c86-4487-aa0f-7dabbceb6962 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:48.396160 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-98041914-4c86-4487-aa0f-7dabbceb6962 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:48.404176 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98041914-4c86-4487-aa0f-7dabbceb6962 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:48.405164 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98041914-4c86-4487-aa0f-7dabbceb6962 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:48.405164 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98041914-4c86-4487-aa0f-7dabbceb6962 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:48.405817 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98041914-4c86-4487-aa0f-7dabbceb6962 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:48.406270 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98041914-4c86-4487-aa0f-7dabbceb6962 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:48.407631 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-98041914-4c86-4487-aa0f-7dabbceb6962 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:48.667334 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5c8dcfb1-6cb7-4fdc-8ded-a6709984583d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:48.679632 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-98041914-4c86-4487-aa0f-7dabbceb6962 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:48.683062 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5c8dcfb1-6cb7-4fdc-8ded-a6709984583d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.309791 Aug 24 09:00:48.683062 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 330/658] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:48 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:48.695778 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-98041914-4c86-4487-aa0f-7dabbceb6962 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:48.698075 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-98041914-4c86-4487-aa0f-7dabbceb6962 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:48.700218 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-98041914-4c86-4487-aa0f-7dabbceb6962 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1747 microversion: 2.20 time: 0.308679 Aug 24 09:00:48.700992 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 329/659] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:48 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1747 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:00:48.810609 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2edbb7bf-6b0b-4d8d-920f-327b797797f3 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:48.811270 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2edbb7bf-6b0b-4d8d-920f-327b797797f3 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:48.818554 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2edbb7bf-6b0b-4d8d-920f-327b797797f3 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:48.819049 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2edbb7bf-6b0b-4d8d-920f-327b797797f3 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:48.819494 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2edbb7bf-6b0b-4d8d-920f-327b797797f3 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:48.820826 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2edbb7bf-6b0b-4d8d-920f-327b797797f3 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:48.820826 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2edbb7bf-6b0b-4d8d-920f-327b797797f3 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:48.821136 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2edbb7bf-6b0b-4d8d-920f-327b797797f3 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:49.002834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2edbb7bf-6b0b-4d8d-920f-327b797797f3 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:49.016249 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2edbb7bf-6b0b-4d8d-920f-327b797797f3 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1471 microversion: 2.1 time: 0.209524 Aug 24 09:00:49.016882 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 331/660] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:48 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1471 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:49.703039 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b903e7c4-aeb2-4618-9e65-46defc7d5a18 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:49.703670 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b903e7c4-aeb2-4618-9e65-46defc7d5a18 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:49.712196 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b903e7c4-aeb2-4618-9e65-46defc7d5a18 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:49.712961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b903e7c4-aeb2-4618-9e65-46defc7d5a18 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:49.713482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b903e7c4-aeb2-4618-9e65-46defc7d5a18 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:49.715886 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b903e7c4-aeb2-4618-9e65-46defc7d5a18 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:49.715886 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b903e7c4-aeb2-4618-9e65-46defc7d5a18 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:49.715886 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b903e7c4-aeb2-4618-9e65-46defc7d5a18 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:49.729163 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4f873075-b9fd-4e0c-a8e7-3b73c5b447f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:49.729783 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4f873075-b9fd-4e0c-a8e7-3b73c5b447f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:49.738290 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f873075-b9fd-4e0c-a8e7-3b73c5b447f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:49.738791 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f873075-b9fd-4e0c-a8e7-3b73c5b447f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:49.739229 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f873075-b9fd-4e0c-a8e7-3b73c5b447f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:49.739945 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f873075-b9fd-4e0c-a8e7-3b73c5b447f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:49.740506 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f873075-b9fd-4e0c-a8e7-3b73c5b447f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:49.740940 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4f873075-b9fd-4e0c-a8e7-3b73c5b447f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:49.928172 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b903e7c4-aeb2-4618-9e65-46defc7d5a18 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:49.934099 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-4f873075-b9fd-4e0c-a8e7-3b73c5b447f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:49.937559 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b903e7c4-aeb2-4618-9e65-46defc7d5a18 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.238403 Aug 24 09:00:49.938132 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 330/661] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:49 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:49.943054 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-4f873075-b9fd-4e0c-a8e7-3b73c5b447f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:49.944582 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-4f873075-b9fd-4e0c-a8e7-3b73c5b447f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:49.945742 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4f873075-b9fd-4e0c-a8e7-3b73c5b447f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1749 microversion: 2.20 time: 0.221044 Aug 24 09:00:49.946323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 332/662] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:49 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1749 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:50.038300 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-833d6ef5-d9d5-4138-8414-638e720c7516 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:50.038826 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-833d6ef5-d9d5-4138-8414-638e720c7516 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:50.045120 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-833d6ef5-d9d5-4138-8414-638e720c7516 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:50.045618 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-833d6ef5-d9d5-4138-8414-638e720c7516 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:50.046062 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-833d6ef5-d9d5-4138-8414-638e720c7516 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:50.046783 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-833d6ef5-d9d5-4138-8414-638e720c7516 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:50.047239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-833d6ef5-d9d5-4138-8414-638e720c7516 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:50.047670 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-833d6ef5-d9d5-4138-8414-638e720c7516 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:50.211512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-833d6ef5-d9d5-4138-8414-638e720c7516 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:50.219783 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-833d6ef5-d9d5-4138-8414-638e720c7516 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1471 microversion: 2.1 time: 0.185436 Aug 24 09:00:50.220396 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 331/663] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:50 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1471 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:50.310977 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-198927414", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-333958261", "security_groups": [{"name": "tempest-secgroup-smoke-1061871461"}], "networks": [{"uuid": "0df2e13b-c444-430a-ad4a-843def5441a0"}], "block_device_mapping_v2": [{"uuid": "e4819fc6-b60c-43df-b3a8-e7b189237274", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:50.444425 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] validate_networks() for [('0df2e13b-c444-430a-ad4a-843def5441a0', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:00:50.903328 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:00:50.903869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:00:50.904276 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:00:50.904694 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:00:50.905139 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:00:50.914719 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:50.915217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:50.915653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:50.916434 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:50.916897 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:50.917333 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:50.936070 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Getting quotas for project 3d68ee6e33664bbfba3b239f16fbbaa0. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:00:50.940495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Getting quotas for user edc56fc598e741ceab98edd3b9afa28c and project 3d68ee6e33664bbfba3b239f16fbbaa0. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:00:50.960494 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-948bbcab-99f9-4bb9-b1e9-31bee69c0804 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:50.961330 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-948bbcab-99f9-4bb9-b1e9-31bee69c0804 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:50.971960 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-948bbcab-99f9-4bb9-b1e9-31bee69c0804 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:50.974149 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-948bbcab-99f9-4bb9-b1e9-31bee69c0804 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:50.974149 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-948bbcab-99f9-4bb9-b1e9-31bee69c0804 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:50.974405 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-948bbcab-99f9-4bb9-b1e9-31bee69c0804 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:50.974836 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-948bbcab-99f9-4bb9-b1e9-31bee69c0804 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:50.975266 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-948bbcab-99f9-4bb9-b1e9-31bee69c0804 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:51.020381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:00:51.023172 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4819fc6-b60c-43df-b3a8-e7b189237274',volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:00:51.127909 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-948bbcab-99f9-4bb9-b1e9-31bee69c0804 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:51.139500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-948bbcab-99f9-4bb9-b1e9-31bee69c0804 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.183417 Aug 24 09:00:51.140670 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 332/664] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:50 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:51.145921 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e3941f93-76dd-4518-b19e-ee30f1936dce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:51.146632 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e3941f93-76dd-4518-b19e-ee30f1936dce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:51.153357 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3941f93-76dd-4518-b19e-ee30f1936dce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:51.153807 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3941f93-76dd-4518-b19e-ee30f1936dce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:51.154222 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3941f93-76dd-4518-b19e-ee30f1936dce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:51.154968 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3941f93-76dd-4518-b19e-ee30f1936dce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:51.155809 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3941f93-76dd-4518-b19e-ee30f1936dce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:51.156337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e3941f93-76dd-4518-b19e-ee30f1936dce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:51.201225 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9e13bd4b-6214-484d-931a-084abc3680c8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.894179 Aug 24 09:00:51.201884 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 333/665] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 09:00:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:00:51.215837 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ff754ba5-a83d-4e1c-abef-f18910f5e30e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:51.220214 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ff754ba5-a83d-4e1c-abef-f18910f5e30e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:51.289584 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff754ba5-a83d-4e1c-abef-f18910f5e30e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:51.306164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ff754ba5-a83d-4e1c-abef-f18910f5e30e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1087 microversion: 2.1 time: 0.095448 Aug 24 09:00:51.306763 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 334/666] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:51 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1087 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:51.312365 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-205f8e8d-b853-48c7-b9de-0cdf03287e84 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:51.312971 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-205f8e8d-b853-48c7-b9de-0cdf03287e84 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:51.320940 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-205f8e8d-b853-48c7-b9de-0cdf03287e84 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:51.321440 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-205f8e8d-b853-48c7-b9de-0cdf03287e84 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:51.321858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-205f8e8d-b853-48c7-b9de-0cdf03287e84 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:51.322557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-205f8e8d-b853-48c7-b9de-0cdf03287e84 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:51.323010 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-205f8e8d-b853-48c7-b9de-0cdf03287e84 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:51.323425 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-205f8e8d-b853-48c7-b9de-0cdf03287e84 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:51.377550 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e3941f93-76dd-4518-b19e-ee30f1936dce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:51.386848 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e3941f93-76dd-4518-b19e-ee30f1936dce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:51.388545 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e3941f93-76dd-4518-b19e-ee30f1936dce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:51.389887 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e3941f93-76dd-4518-b19e-ee30f1936dce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1749 microversion: 2.20 time: 0.248254 Aug 24 09:00:51.390834 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 333/667] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:51 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1749 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:51.519797 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-205f8e8d-b853-48c7-b9de-0cdf03287e84 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:51.536428 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-205f8e8d-b853-48c7-b9de-0cdf03287e84 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1471 microversion: 2.1 time: 0.228507 Aug 24 09:00:51.537066 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 335/668] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:51 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1471 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:52.040981 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-2d59bd79-36b2-41a4-87eb-fee49f969839 req-cf2de9c1-0f6e-4901-ba8f-652dff23f4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b6fff1d-5e5c-41c6-b601-9e141632478c", "name": "network-vif-deleted", "tag": "457985d2-51d4-4966-afb4-606e16726c01"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:52.051510 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2d59bd79-36b2-41a4-87eb-fee49f969839 req-cf2de9c1-0f6e-4901-ba8f-652dff23f4f3 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:52.051998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2d59bd79-36b2-41a4-87eb-fee49f969839 req-cf2de9c1-0f6e-4901-ba8f-652dff23f4f3 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:52.052474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-2d59bd79-36b2-41a4-87eb-fee49f969839 req-cf2de9c1-0f6e-4901-ba8f-652dff23f4f3 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:52.064275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-2d59bd79-36b2-41a4-87eb-fee49f969839 req-cf2de9c1-0f6e-4901-ba8f-652dff23f4f3 service nova] Creating event network-vif-deleted:457985d2-51d4-4966-afb4-606e16726c01 for instance 3b6fff1d-5e5c-41c6-b601-9e141632478c on hv-cinder-83538 Aug 24 09:00:52.070004 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-2d59bd79-36b2-41a4-87eb-fee49f969839 req-cf2de9c1-0f6e-4901-ba8f-652dff23f4f3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032581 Aug 24 09:00:52.070641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 334/669] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:00:52.167912 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e8814bf5-c19a-4cf1-83a7-e36edba71b31 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:52.168729 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e8814bf5-c19a-4cf1-83a7-e36edba71b31 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:52.179089 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8814bf5-c19a-4cf1-83a7-e36edba71b31 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:52.179553 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8814bf5-c19a-4cf1-83a7-e36edba71b31 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:52.180000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8814bf5-c19a-4cf1-83a7-e36edba71b31 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:52.180794 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8814bf5-c19a-4cf1-83a7-e36edba71b31 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:52.181318 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8814bf5-c19a-4cf1-83a7-e36edba71b31 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:52.181754 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8814bf5-c19a-4cf1-83a7-e36edba71b31 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:52.327315 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3e003e32-fedd-4401-9de5-3f6bdce2fa18 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:52.328322 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3e003e32-fedd-4401-9de5-3f6bdce2fa18 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:52.336570 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e003e32-fedd-4401-9de5-3f6bdce2fa18 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:52.337523 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e003e32-fedd-4401-9de5-3f6bdce2fa18 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:52.338135 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e003e32-fedd-4401-9de5-3f6bdce2fa18 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:52.338849 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e003e32-fedd-4401-9de5-3f6bdce2fa18 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:52.339308 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e003e32-fedd-4401-9de5-3f6bdce2fa18 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:52.339898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3e003e32-fedd-4401-9de5-3f6bdce2fa18 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:52.356254 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e8814bf5-c19a-4cf1-83a7-e36edba71b31 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:52.366699 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e8814bf5-c19a-4cf1-83a7-e36edba71b31 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.202765 Aug 24 09:00:52.367644 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 336/670] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:52 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:52.414560 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-55bc09e6-831f-43fd-9b1b-3a49939fbb18 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:52.415347 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-55bc09e6-831f-43fd-9b1b-3a49939fbb18 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:52.415487 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3e003e32-fedd-4401-9de5-3f6bdce2fa18 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:52.421840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55bc09e6-831f-43fd-9b1b-3a49939fbb18 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:52.422327 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55bc09e6-831f-43fd-9b1b-3a49939fbb18 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:52.422767 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55bc09e6-831f-43fd-9b1b-3a49939fbb18 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:52.423481 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55bc09e6-831f-43fd-9b1b-3a49939fbb18 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:52.423939 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55bc09e6-831f-43fd-9b1b-3a49939fbb18 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:52.424083 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3e003e32-fedd-4401-9de5-3f6bdce2fa18 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1185 microversion: 2.1 time: 0.100934 Aug 24 09:00:52.424471 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-55bc09e6-831f-43fd-9b1b-3a49939fbb18 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:52.431892 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 335/671] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:52 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:52.559735 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6a3d50bb-037e-4590-94e0-4e542d5ed107 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:52.562145 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6a3d50bb-037e-4590-94e0-4e542d5ed107 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:52.571280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a3d50bb-037e-4590-94e0-4e542d5ed107 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:52.572447 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a3d50bb-037e-4590-94e0-4e542d5ed107 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:52.573196 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a3d50bb-037e-4590-94e0-4e542d5ed107 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:52.574371 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a3d50bb-037e-4590-94e0-4e542d5ed107 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:52.575154 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a3d50bb-037e-4590-94e0-4e542d5ed107 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:52.575727 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a3d50bb-037e-4590-94e0-4e542d5ed107 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:52.699717 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-6a3d50bb-037e-4590-94e0-4e542d5ed107 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5a1c7fe370643b08d6775190a155d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585066a2274ef3b5a3ff29933e42ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:52.708260 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6a3d50bb-037e-4590-94e0-4e542d5ed107 tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 200 len: 1300 microversion: 2.1 time: 0.153806 Aug 24 09:00:52.708821 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 336/672] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:52 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 1300 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:52.759513 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-55bc09e6-831f-43fd-9b1b-3a49939fbb18 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:52.769360 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-55bc09e6-831f-43fd-9b1b-3a49939fbb18 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:52.770875 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-55bc09e6-831f-43fd-9b1b-3a49939fbb18 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:52.772042 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-55bc09e6-831f-43fd-9b1b-3a49939fbb18 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.362092 Aug 24 09:00:52.772627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 337/673] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:52 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:53.389566 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b0c93088-2a36-4e25-82a6-af98bb0b7d38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:53.390183 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b0c93088-2a36-4e25-82a6-af98bb0b7d38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:53.398125 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0c93088-2a36-4e25-82a6-af98bb0b7d38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:53.399281 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0c93088-2a36-4e25-82a6-af98bb0b7d38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:53.399800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0c93088-2a36-4e25-82a6-af98bb0b7d38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:53.400609 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0c93088-2a36-4e25-82a6-af98bb0b7d38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:53.401131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0c93088-2a36-4e25-82a6-af98bb0b7d38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:53.401659 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0c93088-2a36-4e25-82a6-af98bb0b7d38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:53.447461 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-69061f65-a060-4b34-966c-2f638a9941c3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:53.448662 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-69061f65-a060-4b34-966c-2f638a9941c3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:53.455263 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69061f65-a060-4b34-966c-2f638a9941c3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:53.456920 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69061f65-a060-4b34-966c-2f638a9941c3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:53.457442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69061f65-a060-4b34-966c-2f638a9941c3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:53.458268 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69061f65-a060-4b34-966c-2f638a9941c3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:53.458865 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69061f65-a060-4b34-966c-2f638a9941c3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:53.459364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69061f65-a060-4b34-966c-2f638a9941c3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:53.600444 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-69061f65-a060-4b34-966c-2f638a9941c3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:53.612816 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-69061f65-a060-4b34-966c-2f638a9941c3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1203 microversion: 2.1 time: 0.169345 Aug 24 09:00:53.628282 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 338/674] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:53 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:53.728179 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-0fc4dd67-312a-46fa-95d1-bc455f2ef3f7 req-ecb943d0-7ae7-4cb3-b47d-7b100e8358a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08718641-a85b-4edf-9dc2-c8e30724b3b5", "name": "network-vif-plugged", "status": "completed", "tag": "8c8399ef-892b-41d4-b7ba-affd23dd9979"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:53.744152 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0fc4dd67-312a-46fa-95d1-bc455f2ef3f7 req-ecb943d0-7ae7-4cb3-b47d-7b100e8358a5 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:53.745516 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0fc4dd67-312a-46fa-95d1-bc455f2ef3f7 req-ecb943d0-7ae7-4cb3-b47d-7b100e8358a5 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:53.746189 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0fc4dd67-312a-46fa-95d1-bc455f2ef3f7 req-ecb943d0-7ae7-4cb3-b47d-7b100e8358a5 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:53.748298 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b0c93088-2a36-4e25-82a6-af98bb0b7d38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:53.756925 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b0c93088-2a36-4e25-82a6-af98bb0b7d38 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.371318 Aug 24 09:00:53.761408 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-0fc4dd67-312a-46fa-95d1-bc455f2ef3f7 req-ecb943d0-7ae7-4cb3-b47d-7b100e8358a5 service nova] Creating event network-vif-plugged:8c8399ef-892b-41d4-b7ba-affd23dd9979 for instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 on hv-cinder-83538 Aug 24 09:00:53.768601 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 337/675] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:53 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:53.769268 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-0fc4dd67-312a-46fa-95d1-bc455f2ef3f7 req-ecb943d0-7ae7-4cb3-b47d-7b100e8358a5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047160 Aug 24 09:00:53.772275 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 339/676] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:00:53.777539 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-04a7ca88-8474-4e2d-a9f6-b638e132056f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:53.778184 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-04a7ca88-8474-4e2d-a9f6-b638e132056f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] [instance: 3b6fff1d-5e5c-41c6-b601-9e141632478c] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:53.786852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04a7ca88-8474-4e2d-a9f6-b638e132056f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:53.787356 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04a7ca88-8474-4e2d-a9f6-b638e132056f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:53.787979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04a7ca88-8474-4e2d-a9f6-b638e132056f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:53.788787 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04a7ca88-8474-4e2d-a9f6-b638e132056f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:53.789283 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04a7ca88-8474-4e2d-a9f6-b638e132056f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:53.790029 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04a7ca88-8474-4e2d-a9f6-b638e132056f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:53.801712 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d04000aa-c93b-4d39-b11d-70876783daaf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:53.810879 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d04000aa-c93b-4d39-b11d-70876783daaf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:53.816566 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-04a7ca88-8474-4e2d-a9f6-b638e132056f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] HTTP exception thrown: Instance 3b6fff1d-5e5c-41c6-b601-9e141632478c could not be found. Aug 24 09:00:53.820368 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d04000aa-c93b-4d39-b11d-70876783daaf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:53.820876 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d04000aa-c93b-4d39-b11d-70876783daaf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:53.821433 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d04000aa-c93b-4d39-b11d-70876783daaf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:53.822163 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d04000aa-c93b-4d39-b11d-70876783daaf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-04a7ca88-8474-4e2d-a9f6-b638e132056f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Request method failure captured: Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c HTTP/1.1 Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeimCzOQYHgxcx_F9URyDcgl3EZCUGtE-4m7vb-wqIX4JPu8zsumOPWs5LWY5eQYSJ4zNrl8rKJf3L6qkRKgdYmFHnG5XLr_T00krM09W_x7PkjVBZ2b2fxyQKuYHYqa30ayOqUU5s84OzvxHSoxSshveUQ-DmZJk4Kw0dX4dCw8DvE Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 6e585066a2274ef3b5a3ff29933e42ab Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesNegativeTest-2059948456 Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:00:53.824397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:00:53.826070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6e585066a2274ef3b5a3ff29933e42ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6e585066a2274ef3b5a3ff29933e42ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e585066a2274ef3b5a3ff29933e42ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6e585066a2274ef3b5a3ff29933e42ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:00:53.826070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-VolumesNegativeTest-2059948456 Aug 24 09:00:53.826070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 6e585066a2274ef3b5a3ff29933e42ab Aug 24 09:00:53.826070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesNegativeTest-2059948456 Aug 24 09:00:53.826070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-VolumesNegativeTest-2059948456-project Aug 24 09:00:53.826070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:00:53.826070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:00:53.826070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: d5a1c7fe370643b08d6775190a155d86 Aug 24 09:00:53.826070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-VolumesNegativeTest-2059948456-project Aug 24 09:00:53.826070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:00:53.826070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance 3b6fff1d-5e5c-41c6-b601-9e141632478c could not be found. Aug 24 09:00:53.826070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': '3b6fff1d-5e5c-41c6-b601-9e141632478c'} Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b6fff1d-5e5c-41c6-b601-9e141632478c could not be found. Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:00:53.827094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b6fff1d-5e5c-41c6-b601-9e141632478c could not be found. Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b6fff1d-5e5c-41c6-b601-9e141632478c could not be found. Aug 24 09:00:53.828658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:00:53.829963 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d04000aa-c93b-4d39-b11d-70876783daaf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:53.829963 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d04000aa-c93b-4d39-b11d-70876783daaf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:53.830997 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-04a7ca88-8474-4e2d-a9f6-b638e132056f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] Returning 404 to user: Instance 3b6fff1d-5e5c-41c6-b601-9e141632478c could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:00:53.832081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-04a7ca88-8474-4e2d-a9f6-b638e132056f tempest-VolumesNegativeTest-2059948456 tempest-VolumesNegativeTest-2059948456-project] 10.222.0.67 "GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c" status: 404 len: 111 microversion: 2.1 time: 0.058769 Aug 24 09:00:53.832673 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 338/677] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:53 2022] GET /compute/v2.1/servers/3b6fff1d-5e5c-41c6-b601-9e141632478c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:00:54.459506 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d04000aa-c93b-4d39-b11d-70876783daaf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:54.479044 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d04000aa-c93b-4d39-b11d-70876783daaf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:54.482460 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d04000aa-c93b-4d39-b11d-70876783daaf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:54.484695 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d04000aa-c93b-4d39-b11d-70876783daaf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.692742 Aug 24 09:00:54.485695 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 340/678] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:53 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:54.635207 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-424ae778-6f06-4898-8168-28c28d5e6eef tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:54.636767 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-424ae778-6f06-4898-8168-28c28d5e6eef tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:54.654822 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-424ae778-6f06-4898-8168-28c28d5e6eef tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:54.655394 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-424ae778-6f06-4898-8168-28c28d5e6eef tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:54.655838 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-424ae778-6f06-4898-8168-28c28d5e6eef tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:54.656851 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-424ae778-6f06-4898-8168-28c28d5e6eef tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:54.657492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-424ae778-6f06-4898-8168-28c28d5e6eef tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:54.657927 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-424ae778-6f06-4898-8168-28c28d5e6eef tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:54.781902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8b7bf0eb-9ed7-4df4-bf21-0cad1312da45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:54.782793 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8b7bf0eb-9ed7-4df4-bf21-0cad1312da45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:54.790831 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b7bf0eb-9ed7-4df4-bf21-0cad1312da45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:54.791611 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b7bf0eb-9ed7-4df4-bf21-0cad1312da45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:54.792507 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b7bf0eb-9ed7-4df4-bf21-0cad1312da45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:54.805081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b7bf0eb-9ed7-4df4-bf21-0cad1312da45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:54.807436 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b7bf0eb-9ed7-4df4-bf21-0cad1312da45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:54.808128 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b7bf0eb-9ed7-4df4-bf21-0cad1312da45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:54.890790 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-424ae778-6f06-4898-8168-28c28d5e6eef tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:54.900845 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-424ae778-6f06-4898-8168-28c28d5e6eef tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.269527 Aug 24 09:00:54.901811 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 339/679] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:54 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:55.085816 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8b7bf0eb-9ed7-4df4-bf21-0cad1312da45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:55.100693 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8b7bf0eb-9ed7-4df4-bf21-0cad1312da45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.323064 Aug 24 09:00:55.103320 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 341/680] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:54 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:55.515090 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-73b21ea2-e652-4161-ad18-a95cf08a8fd2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:55.516036 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-73b21ea2-e652-4161-ad18-a95cf08a8fd2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:55.524076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73b21ea2-e652-4161-ad18-a95cf08a8fd2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:55.524745 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73b21ea2-e652-4161-ad18-a95cf08a8fd2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:55.525813 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73b21ea2-e652-4161-ad18-a95cf08a8fd2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:55.526650 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73b21ea2-e652-4161-ad18-a95cf08a8fd2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:55.527761 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73b21ea2-e652-4161-ad18-a95cf08a8fd2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:55.528361 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73b21ea2-e652-4161-ad18-a95cf08a8fd2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:55.554803 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:55.781444 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a9cc592e-a1a4-49a3-8bb0-adb43a452df5 req-e4e74838-3345-4012-b880-102de5a02ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4056ca-2520-4b9f-8d6f-818005b9a13e", "tag": "4e9c44c6-d08e-40f7-8605-73a851811f32"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:00:55.792243 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:55.803059 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a9cc592e-a1a4-49a3-8bb0-adb43a452df5 req-e4e74838-3345-4012-b880-102de5a02ac3 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:55.803810 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a9cc592e-a1a4-49a3-8bb0-adb43a452df5 req-e4e74838-3345-4012-b880-102de5a02ac3 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:55.804443 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a9cc592e-a1a4-49a3-8bb0-adb43a452df5 req-e4e74838-3345-4012-b880-102de5a02ac3 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:55.825380 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a9cc592e-a1a4-49a3-8bb0-adb43a452df5 req-e4e74838-3345-4012-b880-102de5a02ac3 service nova] Creating event network-changed:4e9c44c6-d08e-40f7-8605-73a851811f32 for instance 8c4056ca-2520-4b9f-8d6f-818005b9a13e on hv-cinder-83538 Aug 24 09:00:55.834819 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-73b21ea2-e652-4161-ad18-a95cf08a8fd2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:55.844448 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a9cc592e-a1a4-49a3-8bb0-adb43a452df5 req-e4e74838-3345-4012-b880-102de5a02ac3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066839 Aug 24 09:00:55.845489 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 342/681] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:00:55.849548 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-73b21ea2-e652-4161-ad18-a95cf08a8fd2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:55.853435 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-73b21ea2-e652-4161-ad18-a95cf08a8fd2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:55.854741 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-73b21ea2-e652-4161-ad18-a95cf08a8fd2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.344319 Aug 24 09:00:55.855914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 340/682] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:55 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:55.923912 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d5eca5f9-4a97-4ece-ab79-10289b61844e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:55.925000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d5eca5f9-4a97-4ece-ab79-10289b61844e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:55.933357 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5eca5f9-4a97-4ece-ab79-10289b61844e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:55.933852 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5eca5f9-4a97-4ece-ab79-10289b61844e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:55.934393 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5eca5f9-4a97-4ece-ab79-10289b61844e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:55.935247 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5eca5f9-4a97-4ece-ab79-10289b61844e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:55.935949 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5eca5f9-4a97-4ece-ab79-10289b61844e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:55.936571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d5eca5f9-4a97-4ece-ab79-10289b61844e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:56.125841 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-89c34141-1c88-442b-90c7-4dc0c518b533 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:56.126473 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-89c34141-1c88-442b-90c7-4dc0c518b533 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:56.147053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89c34141-1c88-442b-90c7-4dc0c518b533 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:56.147735 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89c34141-1c88-442b-90c7-4dc0c518b533 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:56.148311 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89c34141-1c88-442b-90c7-4dc0c518b533 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:56.154021 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89c34141-1c88-442b-90c7-4dc0c518b533 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:56.155176 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89c34141-1c88-442b-90c7-4dc0c518b533 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:56.160153 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89c34141-1c88-442b-90c7-4dc0c518b533 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:56.192086 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d5eca5f9-4a97-4ece-ab79-10289b61844e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:56.201972 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d5eca5f9-4a97-4ece-ab79-10289b61844e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.282350 Aug 24 09:00:56.215965 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 343/683] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:55 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:56.402292 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-89c34141-1c88-442b-90c7-4dc0c518b533 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:56.411568 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-89c34141-1c88-442b-90c7-4dc0c518b533 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.290132 Aug 24 09:00:56.412543 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 341/684] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:56 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:56.881079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5b547f4e-c6d3-4e41-8a97-37d4a4b6e377 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:56.882453 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5b547f4e-c6d3-4e41-8a97-37d4a4b6e377 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:56.889262 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b547f4e-c6d3-4e41-8a97-37d4a4b6e377 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:56.890009 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b547f4e-c6d3-4e41-8a97-37d4a4b6e377 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:56.890676 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b547f4e-c6d3-4e41-8a97-37d4a4b6e377 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:56.891704 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b547f4e-c6d3-4e41-8a97-37d4a4b6e377 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:56.892418 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b547f4e-c6d3-4e41-8a97-37d4a4b6e377 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:56.893073 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b547f4e-c6d3-4e41-8a97-37d4a4b6e377 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:57.108600 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5b547f4e-c6d3-4e41-8a97-37d4a4b6e377 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:57.119487 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5b547f4e-c6d3-4e41-8a97-37d4a4b6e377 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:57.121254 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5b547f4e-c6d3-4e41-8a97-37d4a4b6e377 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:57.122664 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5b547f4e-c6d3-4e41-8a97-37d4a4b6e377 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.246978 Aug 24 09:00:57.123403 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 344/685] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:56 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:57.223970 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-404e746f-4f3e-4f66-ab6d-77bfa5289078 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:57.224893 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-404e746f-4f3e-4f66-ab6d-77bfa5289078 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:57.232027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-404e746f-4f3e-4f66-ab6d-77bfa5289078 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:57.232650 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-404e746f-4f3e-4f66-ab6d-77bfa5289078 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:57.233242 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-404e746f-4f3e-4f66-ab6d-77bfa5289078 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:57.234436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-404e746f-4f3e-4f66-ab6d-77bfa5289078 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:57.234944 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-404e746f-4f3e-4f66-ab6d-77bfa5289078 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:57.235448 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-404e746f-4f3e-4f66-ab6d-77bfa5289078 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:57.493478 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-404e746f-4f3e-4f66-ab6d-77bfa5289078 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:57.511607 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-404e746f-4f3e-4f66-ab6d-77bfa5289078 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.291981 Aug 24 09:00:57.515917 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 342/686] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:57 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:57.573731 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4d8e1a69-aa51-4cd3-901d-f2ab2ba52bba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:57.574351 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4d8e1a69-aa51-4cd3-901d-f2ab2ba52bba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:57.580704 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8e1a69-aa51-4cd3-901d-f2ab2ba52bba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:57.581496 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8e1a69-aa51-4cd3-901d-f2ab2ba52bba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:57.582134 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8e1a69-aa51-4cd3-901d-f2ab2ba52bba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:57.582860 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8e1a69-aa51-4cd3-901d-f2ab2ba52bba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:57.583320 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8e1a69-aa51-4cd3-901d-f2ab2ba52bba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:57.583754 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d8e1a69-aa51-4cd3-901d-f2ab2ba52bba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:57.786061 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-4d8e1a69-aa51-4cd3-901d-f2ab2ba52bba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:57.794195 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4d8e1a69-aa51-4cd3-901d-f2ab2ba52bba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.356844 Aug 24 09:00:57.794784 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 345/687] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:57 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:00:58.147120 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c63a6d22-76b5-4d9f-a6be-50df05bdb313 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:58.148170 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c63a6d22-76b5-4d9f-a6be-50df05bdb313 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:58.157469 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c63a6d22-76b5-4d9f-a6be-50df05bdb313 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:58.158238 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c63a6d22-76b5-4d9f-a6be-50df05bdb313 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:58.158857 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c63a6d22-76b5-4d9f-a6be-50df05bdb313 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:58.160029 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c63a6d22-76b5-4d9f-a6be-50df05bdb313 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:58.160674 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c63a6d22-76b5-4d9f-a6be-50df05bdb313 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:58.161264 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c63a6d22-76b5-4d9f-a6be-50df05bdb313 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:58.308995 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c63a6d22-76b5-4d9f-a6be-50df05bdb313 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:58.319266 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c63a6d22-76b5-4d9f-a6be-50df05bdb313 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:58.321207 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c63a6d22-76b5-4d9f-a6be-50df05bdb313 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:58.322620 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c63a6d22-76b5-4d9f-a6be-50df05bdb313 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.179917 Aug 24 09:00:58.336120 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 343/688] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:58 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:58.536384 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-77818977-d83e-4ff9-90db-d53ea8a2de9e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:58.538825 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-77818977-d83e-4ff9-90db-d53ea8a2de9e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:58.546810 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77818977-d83e-4ff9-90db-d53ea8a2de9e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:58.547444 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77818977-d83e-4ff9-90db-d53ea8a2de9e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:58.548209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77818977-d83e-4ff9-90db-d53ea8a2de9e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:58.549181 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77818977-d83e-4ff9-90db-d53ea8a2de9e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:58.550349 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77818977-d83e-4ff9-90db-d53ea8a2de9e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:58.550784 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-77818977-d83e-4ff9-90db-d53ea8a2de9e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:58.716418 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-77818977-d83e-4ff9-90db-d53ea8a2de9e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:58.726748 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-77818977-d83e-4ff9-90db-d53ea8a2de9e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.195335 Aug 24 09:00:58.730813 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 346/689] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:58 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:58.818719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-059132e2-6c64-4f58-a320-2c425959ec0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:58.819650 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-059132e2-6c64-4f58-a320-2c425959ec0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:58.826044 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-059132e2-6c64-4f58-a320-2c425959ec0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:58.827097 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-059132e2-6c64-4f58-a320-2c425959ec0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:58.827548 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-059132e2-6c64-4f58-a320-2c425959ec0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:58.828296 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-059132e2-6c64-4f58-a320-2c425959ec0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:58.829122 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-059132e2-6c64-4f58-a320-2c425959ec0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:58.829831 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-059132e2-6c64-4f58-a320-2c425959ec0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:58.982209 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-059132e2-6c64-4f58-a320-2c425959ec0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:58.993256 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-059132e2-6c64-4f58-a320-2c425959ec0a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.178530 Aug 24 09:00:58.994450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 344/690] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:58 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:00:59.346452 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9da90c46-52c2-4fc5-9997-71f3416864d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:59.347148 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9da90c46-52c2-4fc5-9997-71f3416864d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:59.355060 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9da90c46-52c2-4fc5-9997-71f3416864d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:59.355891 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9da90c46-52c2-4fc5-9997-71f3416864d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:59.356359 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9da90c46-52c2-4fc5-9997-71f3416864d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:59.357470 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9da90c46-52c2-4fc5-9997-71f3416864d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:59.358676 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9da90c46-52c2-4fc5-9997-71f3416864d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:59.359328 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9da90c46-52c2-4fc5-9997-71f3416864d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:59.543104 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9da90c46-52c2-4fc5-9997-71f3416864d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:59.555828 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9da90c46-52c2-4fc5-9997-71f3416864d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:59.558635 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9da90c46-52c2-4fc5-9997-71f3416864d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:59.560382 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9da90c46-52c2-4fc5-9997-71f3416864d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.218533 Aug 24 09:00:59.561540 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 347/691] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:00:59 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:00:59.751316 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-62e2efda-8bbe-4bcb-8f45-7bf8be13c293 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:00:59.751948 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-62e2efda-8bbe-4bcb-8f45-7bf8be13c293 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:00:59.761128 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62e2efda-8bbe-4bcb-8f45-7bf8be13c293 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:59.761892 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62e2efda-8bbe-4bcb-8f45-7bf8be13c293 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:59.762344 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62e2efda-8bbe-4bcb-8f45-7bf8be13c293 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:59.763146 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62e2efda-8bbe-4bcb-8f45-7bf8be13c293 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:00:59.763616 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62e2efda-8bbe-4bcb-8f45-7bf8be13c293 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:00:59.764232 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-62e2efda-8bbe-4bcb-8f45-7bf8be13c293 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:00:59.926204 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-62e2efda-8bbe-4bcb-8f45-7bf8be13c293 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:00:59.934265 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-62e2efda-8bbe-4bcb-8f45-7bf8be13c293 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.186776 Aug 24 09:00:59.934703 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 345/692] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:00:59 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:00.016246 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a52f7dda-f98d-4ecc-9f4e-063cb1c641e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:00.017262 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a52f7dda-f98d-4ecc-9f4e-063cb1c641e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:00.024334 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a52f7dda-f98d-4ecc-9f4e-063cb1c641e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:00.024967 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a52f7dda-f98d-4ecc-9f4e-063cb1c641e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:00.026119 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a52f7dda-f98d-4ecc-9f4e-063cb1c641e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:00.026905 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a52f7dda-f98d-4ecc-9f4e-063cb1c641e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:00.027438 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a52f7dda-f98d-4ecc-9f4e-063cb1c641e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:00.027929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a52f7dda-f98d-4ecc-9f4e-063cb1c641e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:00.195280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a52f7dda-f98d-4ecc-9f4e-063cb1c641e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:00.208990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a52f7dda-f98d-4ecc-9f4e-063cb1c641e5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.197636 Aug 24 09:01:00.209783 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 348/693] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:00 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:00.587149 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-21a29932-dfe1-4dbd-97bf-cd753fe24702 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:00.587804 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-21a29932-dfe1-4dbd-97bf-cd753fe24702 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:00.593903 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a29932-dfe1-4dbd-97bf-cd753fe24702 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:00.594431 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a29932-dfe1-4dbd-97bf-cd753fe24702 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:00.594876 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a29932-dfe1-4dbd-97bf-cd753fe24702 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:00.595592 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a29932-dfe1-4dbd-97bf-cd753fe24702 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:00.596053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a29932-dfe1-4dbd-97bf-cd753fe24702 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:00.597046 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21a29932-dfe1-4dbd-97bf-cd753fe24702 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:00.766356 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-21a29932-dfe1-4dbd-97bf-cd753fe24702 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:00.776046 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-21a29932-dfe1-4dbd-97bf-cd753fe24702 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:00.777616 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-21a29932-dfe1-4dbd-97bf-cd753fe24702 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:00.778798 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-21a29932-dfe1-4dbd-97bf-cd753fe24702 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.195565 Aug 24 09:01:00.779358 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 346/694] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:00 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:00.959456 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-458096d4-e27b-46df-8e9e-bfeb2505dcc8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:00.961055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-458096d4-e27b-46df-8e9e-bfeb2505dcc8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:00.968435 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:00.970769 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-458096d4-e27b-46df-8e9e-bfeb2505dcc8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:00.972484 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-458096d4-e27b-46df-8e9e-bfeb2505dcc8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:00.973166 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-458096d4-e27b-46df-8e9e-bfeb2505dcc8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:00.974103 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-458096d4-e27b-46df-8e9e-bfeb2505dcc8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:00.974648 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-458096d4-e27b-46df-8e9e-bfeb2505dcc8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:00.975079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-458096d4-e27b-46df-8e9e-bfeb2505dcc8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:00.998632 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:01.158937 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-458096d4-e27b-46df-8e9e-bfeb2505dcc8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:01.174123 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-458096d4-e27b-46df-8e9e-bfeb2505dcc8 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.222504 Aug 24 09:01:01.175186 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 349/695] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:00 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:01.230195 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1bb63408-cc4c-4de3-a03a-59797820ccc0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:01.230724 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1bb63408-cc4c-4de3-a03a-59797820ccc0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:01.236832 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bb63408-cc4c-4de3-a03a-59797820ccc0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:01.237361 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bb63408-cc4c-4de3-a03a-59797820ccc0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:01.237803 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bb63408-cc4c-4de3-a03a-59797820ccc0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:01.238508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bb63408-cc4c-4de3-a03a-59797820ccc0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:01.238970 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bb63408-cc4c-4de3-a03a-59797820ccc0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:01.239402 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bb63408-cc4c-4de3-a03a-59797820ccc0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:01.422705 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1bb63408-cc4c-4de3-a03a-59797820ccc0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:01.431220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1bb63408-cc4c-4de3-a03a-59797820ccc0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.205069 Aug 24 09:01:01.431800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 347/696] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:01 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:01.802885 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c806b53c-e49e-4e24-a556-1f2e5cb3022e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:01.803410 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c806b53c-e49e-4e24-a556-1f2e5cb3022e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:01.805437 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:01.812353 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c806b53c-e49e-4e24-a556-1f2e5cb3022e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:01.812353 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c806b53c-e49e-4e24-a556-1f2e5cb3022e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:01.812681 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c806b53c-e49e-4e24-a556-1f2e5cb3022e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:01.813320 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c806b53c-e49e-4e24-a556-1f2e5cb3022e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:01.813784 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c806b53c-e49e-4e24-a556-1f2e5cb3022e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:01.814213 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c806b53c-e49e-4e24-a556-1f2e5cb3022e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:01.991042 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c806b53c-e49e-4e24-a556-1f2e5cb3022e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:02.000628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c806b53c-e49e-4e24-a556-1f2e5cb3022e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:02.002304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c806b53c-e49e-4e24-a556-1f2e5cb3022e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:02.003346 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c806b53c-e49e-4e24-a556-1f2e5cb3022e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.205147 Aug 24 09:01:02.003930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 350/697] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:01 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:02.201244 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c9da4727-74d7-4fc4-af91-607a1807b8e4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:02.202338 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c9da4727-74d7-4fc4-af91-607a1807b8e4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:02.208597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9da4727-74d7-4fc4-af91-607a1807b8e4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:02.209094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9da4727-74d7-4fc4-af91-607a1807b8e4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:02.209538 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9da4727-74d7-4fc4-af91-607a1807b8e4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:02.210251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9da4727-74d7-4fc4-af91-607a1807b8e4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:02.210715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9da4727-74d7-4fc4-af91-607a1807b8e4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:02.211143 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c9da4727-74d7-4fc4-af91-607a1807b8e4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:02.362988 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c9da4727-74d7-4fc4-af91-607a1807b8e4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:02.376932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c9da4727-74d7-4fc4-af91-607a1807b8e4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.179676 Aug 24 09:01:02.378042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 348/698] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:02 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:02.455251 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0cb61331-f6a9-4e1c-bd8c-a79f25951949 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:02.455771 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0cb61331-f6a9-4e1c-bd8c-a79f25951949 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:02.463699 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cb61331-f6a9-4e1c-bd8c-a79f25951949 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:02.464473 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cb61331-f6a9-4e1c-bd8c-a79f25951949 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:02.464655 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cb61331-f6a9-4e1c-bd8c-a79f25951949 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:02.465364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cb61331-f6a9-4e1c-bd8c-a79f25951949 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:02.465824 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cb61331-f6a9-4e1c-bd8c-a79f25951949 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:02.466259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0cb61331-f6a9-4e1c-bd8c-a79f25951949 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:02.634361 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0cb61331-f6a9-4e1c-bd8c-a79f25951949 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:02.642853 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0cb61331-f6a9-4e1c-bd8c-a79f25951949 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.191828 Aug 24 09:01:02.644165 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 351/699] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:02 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:03.028383 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f34380b7-2378-4e7e-9cf2-2773deae4328 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:03.029210 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f34380b7-2378-4e7e-9cf2-2773deae4328 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:03.036079 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f34380b7-2378-4e7e-9cf2-2773deae4328 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:03.036607 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f34380b7-2378-4e7e-9cf2-2773deae4328 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:03.037048 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f34380b7-2378-4e7e-9cf2-2773deae4328 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:03.037773 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f34380b7-2378-4e7e-9cf2-2773deae4328 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:03.038331 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f34380b7-2378-4e7e-9cf2-2773deae4328 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:03.038770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f34380b7-2378-4e7e-9cf2-2773deae4328 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:03.202754 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f34380b7-2378-4e7e-9cf2-2773deae4328 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:03.213445 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f34380b7-2378-4e7e-9cf2-2773deae4328 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:03.214994 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f34380b7-2378-4e7e-9cf2-2773deae4328 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:03.216267 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f34380b7-2378-4e7e-9cf2-2773deae4328 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.192047 Aug 24 09:01:03.225545 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 349/700] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:03 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:03.399611 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f928f62b-641f-46b5-927d-2faf2bac09cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:03.400421 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f928f62b-641f-46b5-927d-2faf2bac09cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:03.406911 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f928f62b-641f-46b5-927d-2faf2bac09cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:03.407357 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f928f62b-641f-46b5-927d-2faf2bac09cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:03.407803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f928f62b-641f-46b5-927d-2faf2bac09cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:03.408586 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f928f62b-641f-46b5-927d-2faf2bac09cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:03.409794 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f928f62b-641f-46b5-927d-2faf2bac09cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:03.410472 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f928f62b-641f-46b5-927d-2faf2bac09cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:03.564879 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f928f62b-641f-46b5-927d-2faf2bac09cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:03.577867 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f928f62b-641f-46b5-927d-2faf2bac09cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.181976 Aug 24 09:01:03.578753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 352/701] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:03 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:03.665067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8a577358-2f13-4192-b80c-f5c84c06ca71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:03.665617 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8a577358-2f13-4192-b80c-f5c84c06ca71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:03.683265 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a577358-2f13-4192-b80c-f5c84c06ca71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:03.683781 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a577358-2f13-4192-b80c-f5c84c06ca71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:03.684247 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a577358-2f13-4192-b80c-f5c84c06ca71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:03.684972 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a577358-2f13-4192-b80c-f5c84c06ca71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:03.685434 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a577358-2f13-4192-b80c-f5c84c06ca71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:03.685858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a577358-2f13-4192-b80c-f5c84c06ca71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:03.849201 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8a577358-2f13-4192-b80c-f5c84c06ca71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:03.859029 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8a577358-2f13-4192-b80c-f5c84c06ca71 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.197883 Aug 24 09:01:03.860611 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 350/702] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:03 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:04.244544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6c975af7-59e1-42d5-94f9-e3aba30baeb1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:04.245192 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6c975af7-59e1-42d5-94f9-e3aba30baeb1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:04.252474 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c975af7-59e1-42d5-94f9-e3aba30baeb1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:04.253552 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c975af7-59e1-42d5-94f9-e3aba30baeb1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:04.254221 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c975af7-59e1-42d5-94f9-e3aba30baeb1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:04.255372 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c975af7-59e1-42d5-94f9-e3aba30baeb1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:04.256145 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c975af7-59e1-42d5-94f9-e3aba30baeb1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:04.256943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6c975af7-59e1-42d5-94f9-e3aba30baeb1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:04.411323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6c975af7-59e1-42d5-94f9-e3aba30baeb1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:04.421936 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6c975af7-59e1-42d5-94f9-e3aba30baeb1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:04.423432 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6c975af7-59e1-42d5-94f9-e3aba30baeb1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:04.424658 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6c975af7-59e1-42d5-94f9-e3aba30baeb1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.184851 Aug 24 09:01:04.425498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 353/703] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:04 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:04.599728 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8f432167-0e34-48aa-854f-4ec833d6a4d0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:04.600392 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8f432167-0e34-48aa-854f-4ec833d6a4d0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:04.607204 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f432167-0e34-48aa-854f-4ec833d6a4d0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:04.607701 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f432167-0e34-48aa-854f-4ec833d6a4d0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:04.608166 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f432167-0e34-48aa-854f-4ec833d6a4d0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:04.608929 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f432167-0e34-48aa-854f-4ec833d6a4d0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:04.609356 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f432167-0e34-48aa-854f-4ec833d6a4d0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:04.609787 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8f432167-0e34-48aa-854f-4ec833d6a4d0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:04.756341 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8f432167-0e34-48aa-854f-4ec833d6a4d0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:04.769750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8f432167-0e34-48aa-854f-4ec833d6a4d0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.173205 Aug 24 09:01:04.770798 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 351/704] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:04 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:04.883776 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-250b9e9b-2d7c-4837-a15e-021594e683e3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:04.884417 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-250b9e9b-2d7c-4837-a15e-021594e683e3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:04.890805 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-250b9e9b-2d7c-4837-a15e-021594e683e3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:04.891303 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-250b9e9b-2d7c-4837-a15e-021594e683e3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:04.891747 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-250b9e9b-2d7c-4837-a15e-021594e683e3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:04.892500 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-250b9e9b-2d7c-4837-a15e-021594e683e3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:04.892989 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-250b9e9b-2d7c-4837-a15e-021594e683e3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:04.893419 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-250b9e9b-2d7c-4837-a15e-021594e683e3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:05.037695 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-250b9e9b-2d7c-4837-a15e-021594e683e3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:05.045916 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-250b9e9b-2d7c-4837-a15e-021594e683e3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.167081 Aug 24 09:01:05.046500 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 354/705] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:04 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:05.452747 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8de6479a-9898-46d1-96b4-c5bdac915e00 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:05.453421 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8de6479a-9898-46d1-96b4-c5bdac915e00 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:05.460259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8de6479a-9898-46d1-96b4-c5bdac915e00 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:05.460761 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8de6479a-9898-46d1-96b4-c5bdac915e00 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:05.461200 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8de6479a-9898-46d1-96b4-c5bdac915e00 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:05.461909 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8de6479a-9898-46d1-96b4-c5bdac915e00 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:05.462373 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8de6479a-9898-46d1-96b4-c5bdac915e00 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:05.462800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8de6479a-9898-46d1-96b4-c5bdac915e00 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:05.604732 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8de6479a-9898-46d1-96b4-c5bdac915e00 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:05.614829 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8de6479a-9898-46d1-96b4-c5bdac915e00 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:05.616382 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8de6479a-9898-46d1-96b4-c5bdac915e00 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:05.617562 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8de6479a-9898-46d1-96b4-c5bdac915e00 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.168897 Aug 24 09:01:05.618120 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 352/706] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:05 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:01:05.791358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-913187f4-e4c4-4672-933d-68dc7b2ed054 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:05.792010 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-913187f4-e4c4-4672-933d-68dc7b2ed054 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:05.797910 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-913187f4-e4c4-4672-933d-68dc7b2ed054 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:05.798392 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-913187f4-e4c4-4672-933d-68dc7b2ed054 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:05.798866 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-913187f4-e4c4-4672-933d-68dc7b2ed054 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:05.799700 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-913187f4-e4c4-4672-933d-68dc7b2ed054 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:05.800528 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-913187f4-e4c4-4672-933d-68dc7b2ed054 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:05.801274 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-913187f4-e4c4-4672-933d-68dc7b2ed054 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:05.942097 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-913187f4-e4c4-4672-933d-68dc7b2ed054 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:05.950035 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-913187f4-e4c4-4672-933d-68dc7b2ed054 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.162491 Aug 24 09:01:05.950614 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 355/707] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:05 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:06.068624 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6d848593-dca4-42b8-b5a2-f364e6f03616 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:06.069146 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6d848593-dca4-42b8-b5a2-f364e6f03616 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:06.076005 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d848593-dca4-42b8-b5a2-f364e6f03616 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:06.076517 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d848593-dca4-42b8-b5a2-f364e6f03616 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:06.077208 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d848593-dca4-42b8-b5a2-f364e6f03616 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:06.078116 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d848593-dca4-42b8-b5a2-f364e6f03616 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:06.078657 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d848593-dca4-42b8-b5a2-f364e6f03616 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:06.079098 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d848593-dca4-42b8-b5a2-f364e6f03616 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:06.222017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-6d848593-dca4-42b8-b5a2-f364e6f03616 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:06.230032 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6d848593-dca4-42b8-b5a2-f364e6f03616 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.165894 Aug 24 09:01:06.230520 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 353/708] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:06 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:06.640533 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5630db4f-24af-4ad9-852b-740a0e40e956 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:06.641138 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5630db4f-24af-4ad9-852b-740a0e40e956 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:06.647251 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5630db4f-24af-4ad9-852b-740a0e40e956 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:06.647742 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5630db4f-24af-4ad9-852b-740a0e40e956 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:06.648218 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5630db4f-24af-4ad9-852b-740a0e40e956 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:06.648926 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5630db4f-24af-4ad9-852b-740a0e40e956 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:06.649382 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5630db4f-24af-4ad9-852b-740a0e40e956 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:06.649806 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5630db4f-24af-4ad9-852b-740a0e40e956 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:06.779893 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5630db4f-24af-4ad9-852b-740a0e40e956 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:06.789101 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5630db4f-24af-4ad9-852b-740a0e40e956 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:06.790629 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5630db4f-24af-4ad9-852b-740a0e40e956 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:06.791794 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5630db4f-24af-4ad9-852b-740a0e40e956 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.155558 Aug 24 09:01:06.792381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 356/709] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:06 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:06.971032 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-05c9f3ee-7df5-48d6-be8b-961484117231 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:06.971613 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-05c9f3ee-7df5-48d6-be8b-961484117231 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:06.978732 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05c9f3ee-7df5-48d6-be8b-961484117231 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:06.979299 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05c9f3ee-7df5-48d6-be8b-961484117231 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:06.979731 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05c9f3ee-7df5-48d6-be8b-961484117231 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:06.980491 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05c9f3ee-7df5-48d6-be8b-961484117231 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:06.980942 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05c9f3ee-7df5-48d6-be8b-961484117231 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:06.981363 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05c9f3ee-7df5-48d6-be8b-961484117231 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:07.120153 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-05c9f3ee-7df5-48d6-be8b-961484117231 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:07.128294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-05c9f3ee-7df5-48d6-be8b-961484117231 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.161153 Aug 24 09:01:07.129007 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 354/710] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:06 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:07.251254 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-395015a4-0f29-4fc8-8083-46286ee4826a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:07.251868 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-395015a4-0f29-4fc8-8083-46286ee4826a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:07.258633 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-395015a4-0f29-4fc8-8083-46286ee4826a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:07.259120 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-395015a4-0f29-4fc8-8083-46286ee4826a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:07.259562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-395015a4-0f29-4fc8-8083-46286ee4826a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:07.260303 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-395015a4-0f29-4fc8-8083-46286ee4826a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:07.260767 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-395015a4-0f29-4fc8-8083-46286ee4826a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:07.261232 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-395015a4-0f29-4fc8-8083-46286ee4826a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:07.392816 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-395015a4-0f29-4fc8-8083-46286ee4826a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:07.401261 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-395015a4-0f29-4fc8-8083-46286ee4826a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1366 microversion: 2.1 time: 0.153882 Aug 24 09:01:07.401842 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 357/711] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:07 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:07.816291 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3f154f16-dd3c-417d-bc8a-3ab28fd50e1b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:07.817313 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3f154f16-dd3c-417d-bc8a-3ab28fd50e1b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:07.823785 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f154f16-dd3c-417d-bc8a-3ab28fd50e1b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:07.824398 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f154f16-dd3c-417d-bc8a-3ab28fd50e1b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:07.825696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f154f16-dd3c-417d-bc8a-3ab28fd50e1b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:07.826532 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f154f16-dd3c-417d-bc8a-3ab28fd50e1b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:07.827019 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f154f16-dd3c-417d-bc8a-3ab28fd50e1b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:07.827483 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f154f16-dd3c-417d-bc8a-3ab28fd50e1b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:07.967431 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3f154f16-dd3c-417d-bc8a-3ab28fd50e1b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:07.977643 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3f154f16-dd3c-417d-bc8a-3ab28fd50e1b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:07.979136 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3f154f16-dd3c-417d-bc8a-3ab28fd50e1b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:07.980322 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3f154f16-dd3c-417d-bc8a-3ab28fd50e1b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.168716 Aug 24 09:01:07.980875 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 355/712] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:07 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:01:08.149763 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-891b0a83-1a25-42b1-b404-15b9368c7069 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:08.150884 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-891b0a83-1a25-42b1-b404-15b9368c7069 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:08.160497 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-891b0a83-1a25-42b1-b404-15b9368c7069 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:08.160993 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-891b0a83-1a25-42b1-b404-15b9368c7069 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:08.161429 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-891b0a83-1a25-42b1-b404-15b9368c7069 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:08.162135 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-891b0a83-1a25-42b1-b404-15b9368c7069 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:08.162587 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-891b0a83-1a25-42b1-b404-15b9368c7069 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:08.163006 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-891b0a83-1a25-42b1-b404-15b9368c7069 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:08.306590 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-891b0a83-1a25-42b1-b404-15b9368c7069 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:08.314416 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-891b0a83-1a25-42b1-b404-15b9368c7069 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.169588 Aug 24 09:01:08.314987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 358/713] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:08 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:08.421568 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-73b09027-74d7-4951-b11a-12190ecf9536 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:08.422182 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-73b09027-74d7-4951-b11a-12190ecf9536 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:08.436050 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73b09027-74d7-4951-b11a-12190ecf9536 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:08.436849 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73b09027-74d7-4951-b11a-12190ecf9536 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:08.437449 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73b09027-74d7-4951-b11a-12190ecf9536 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:08.438363 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73b09027-74d7-4951-b11a-12190ecf9536 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:08.439020 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73b09027-74d7-4951-b11a-12190ecf9536 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:08.439628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-73b09027-74d7-4951-b11a-12190ecf9536 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:08.604400 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-73b09027-74d7-4951-b11a-12190ecf9536 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:08.612151 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-73b09027-74d7-4951-b11a-12190ecf9536 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1554 microversion: 2.1 time: 0.194459 Aug 24 09:01:08.613246 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 356/714] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:08 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:08.633259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9df0a9e0-ace9-4ad9-adc0-50c8f5a7f0d7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:08.633754 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9df0a9e0-ace9-4ad9-adc0-50c8f5a7f0d7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:08.639942 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9df0a9e0-ace9-4ad9-adc0-50c8f5a7f0d7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:08.640471 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9df0a9e0-ace9-4ad9-adc0-50c8f5a7f0d7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:08.640909 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9df0a9e0-ace9-4ad9-adc0-50c8f5a7f0d7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:08.641602 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9df0a9e0-ace9-4ad9-adc0-50c8f5a7f0d7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:08.642059 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9df0a9e0-ace9-4ad9-adc0-50c8f5a7f0d7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:08.642485 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9df0a9e0-ace9-4ad9-adc0-50c8f5a7f0d7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:08.718101 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9df0a9e0-ace9-4ad9-adc0-50c8f5a7f0d7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088654 Aug 24 09:01:08.718730 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 359/715] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 24 09:01:08 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:01:09.004739 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9b0ed22f-ac78-4a2f-8724-4be1b7a7413d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:09.005335 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9b0ed22f-ac78-4a2f-8724-4be1b7a7413d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:09.007711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:09.013446 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b0ed22f-ac78-4a2f-8724-4be1b7a7413d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:09.013945 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b0ed22f-ac78-4a2f-8724-4be1b7a7413d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:09.014392 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b0ed22f-ac78-4a2f-8724-4be1b7a7413d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:09.015102 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b0ed22f-ac78-4a2f-8724-4be1b7a7413d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:09.015563 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b0ed22f-ac78-4a2f-8724-4be1b7a7413d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:09.015992 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9b0ed22f-ac78-4a2f-8724-4be1b7a7413d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:09.022020 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:09.278159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9b0ed22f-ac78-4a2f-8724-4be1b7a7413d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:09.287034 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9b0ed22f-ac78-4a2f-8724-4be1b7a7413d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:09.288601 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9b0ed22f-ac78-4a2f-8724-4be1b7a7413d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:09.289799 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9b0ed22f-ac78-4a2f-8724-4be1b7a7413d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.290051 Aug 24 09:01:09.290357 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 357/716] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:08 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:09.335574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b083d724-e798-4f20-b411-b9bf477266c4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:09.336317 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b083d724-e798-4f20-b411-b9bf477266c4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:09.342331 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b083d724-e798-4f20-b411-b9bf477266c4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:09.342892 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b083d724-e798-4f20-b411-b9bf477266c4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:09.343399 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b083d724-e798-4f20-b411-b9bf477266c4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:09.344261 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b083d724-e798-4f20-b411-b9bf477266c4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:09.344791 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b083d724-e798-4f20-b411-b9bf477266c4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:09.345308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b083d724-e798-4f20-b411-b9bf477266c4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:09.571074 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b083d724-e798-4f20-b411-b9bf477266c4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:09.578809 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b083d724-e798-4f20-b411-b9bf477266c4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.247159 Aug 24 09:01:09.579387 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 360/717] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:09 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:09.841033 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-f98e1d65-beb8-4474-b851-4d12d2d31972 req-66799f88-ace8-4938-8487-6b794b25c9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08718641-a85b-4edf-9dc2-c8e30724b3b5", "tag": "8c8399ef-892b-41d4-b7ba-affd23dd9979"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:09.851632 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f98e1d65-beb8-4474-b851-4d12d2d31972 req-66799f88-ace8-4938-8487-6b794b25c9a2 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:09.852232 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f98e1d65-beb8-4474-b851-4d12d2d31972 req-66799f88-ace8-4938-8487-6b794b25c9a2 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:09.852736 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-f98e1d65-beb8-4474-b851-4d12d2d31972 req-66799f88-ace8-4938-8487-6b794b25c9a2 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:09.866067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-f98e1d65-beb8-4474-b851-4d12d2d31972 req-66799f88-ace8-4938-8487-6b794b25c9a2 service nova] Creating event network-changed:8c8399ef-892b-41d4-b7ba-affd23dd9979 for instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 on hv-cinder-83538 Aug 24 09:01:09.871064 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-f98e1d65-beb8-4474-b851-4d12d2d31972 req-66799f88-ace8-4938-8487-6b794b25c9a2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033675 Aug 24 09:01:09.871972 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 358/718] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:01:10.316890 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7cfee3a3-543c-4468-bbb7-8b02fb927ab6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:10.317921 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7cfee3a3-543c-4468-bbb7-8b02fb927ab6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:10.325592 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7cfee3a3-543c-4468-bbb7-8b02fb927ab6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:10.326522 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7cfee3a3-543c-4468-bbb7-8b02fb927ab6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:10.327175 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7cfee3a3-543c-4468-bbb7-8b02fb927ab6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:10.328179 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7cfee3a3-543c-4468-bbb7-8b02fb927ab6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:10.328666 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7cfee3a3-543c-4468-bbb7-8b02fb927ab6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:10.329100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7cfee3a3-543c-4468-bbb7-8b02fb927ab6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:10.601475 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-aabc08ad-c9a6-4e24-b76e-3ba1c29ec60a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:10.602513 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-aabc08ad-c9a6-4e24-b76e-3ba1c29ec60a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:10.609654 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aabc08ad-c9a6-4e24-b76e-3ba1c29ec60a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:10.610318 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aabc08ad-c9a6-4e24-b76e-3ba1c29ec60a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:10.610863 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aabc08ad-c9a6-4e24-b76e-3ba1c29ec60a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:10.611700 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aabc08ad-c9a6-4e24-b76e-3ba1c29ec60a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:10.612332 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aabc08ad-c9a6-4e24-b76e-3ba1c29ec60a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:10.613581 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aabc08ad-c9a6-4e24-b76e-3ba1c29ec60a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:10.959641 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7cfee3a3-543c-4468-bbb7-8b02fb927ab6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:10.969904 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7cfee3a3-543c-4468-bbb7-8b02fb927ab6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:10.971738 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7cfee3a3-543c-4468-bbb7-8b02fb927ab6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:10.974242 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7cfee3a3-543c-4468-bbb7-8b02fb927ab6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.663881 Aug 24 09:01:10.974969 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 361/719] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:10 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:11.123161 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-aabc08ad-c9a6-4e24-b76e-3ba1c29ec60a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:11.131714 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-aabc08ad-c9a6-4e24-b76e-3ba1c29ec60a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.536007 Aug 24 09:01:11.132317 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 359/720] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:10 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:11.999183 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-869898c2-38e5-4262-9a84-9ac928596664 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:11.999764 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-869898c2-38e5-4262-9a84-9ac928596664 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:12.006411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-869898c2-38e5-4262-9a84-9ac928596664 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:12.006904 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-869898c2-38e5-4262-9a84-9ac928596664 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:12.007448 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-869898c2-38e5-4262-9a84-9ac928596664 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:12.008233 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-869898c2-38e5-4262-9a84-9ac928596664 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:12.008703 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-869898c2-38e5-4262-9a84-9ac928596664 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:12.009277 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-869898c2-38e5-4262-9a84-9ac928596664 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:12.153426 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-869898c2-38e5-4262-9a84-9ac928596664 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:12.154612 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-910fea0a-5f75-44ee-9a98-6cd493cefbd6 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:12.155234 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-910fea0a-5f75-44ee-9a98-6cd493cefbd6 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:12.162353 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-910fea0a-5f75-44ee-9a98-6cd493cefbd6 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:12.163032 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-910fea0a-5f75-44ee-9a98-6cd493cefbd6 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:12.163658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-910fea0a-5f75-44ee-9a98-6cd493cefbd6 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:12.164521 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-910fea0a-5f75-44ee-9a98-6cd493cefbd6 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:12.164988 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-910fea0a-5f75-44ee-9a98-6cd493cefbd6 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:12.165409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-910fea0a-5f75-44ee-9a98-6cd493cefbd6 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:12.166131 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-869898c2-38e5-4262-9a84-9ac928596664 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:12.167826 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-869898c2-38e5-4262-9a84-9ac928596664 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:12.169089 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-869898c2-38e5-4262-9a84-9ac928596664 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.174079 Aug 24 09:01:12.169793 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 362/721] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:11 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:12.309935 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-910fea0a-5f75-44ee-9a98-6cd493cefbd6 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:12.317942 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-910fea0a-5f75-44ee-9a98-6cd493cefbd6 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.167749 Aug 24 09:01:12.318502 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 360/722] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:12 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:13.198468 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6dabf65a-a8e3-4d8b-8625-619b3460f4b1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:13.198468 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6dabf65a-a8e3-4d8b-8625-619b3460f4b1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:13.199915 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dabf65a-a8e3-4d8b-8625-619b3460f4b1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:13.200440 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dabf65a-a8e3-4d8b-8625-619b3460f4b1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:13.200889 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dabf65a-a8e3-4d8b-8625-619b3460f4b1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:13.201609 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dabf65a-a8e3-4d8b-8625-619b3460f4b1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:13.202088 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dabf65a-a8e3-4d8b-8625-619b3460f4b1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:13.202515 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6dabf65a-a8e3-4d8b-8625-619b3460f4b1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:13.336441 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6dabf65a-a8e3-4d8b-8625-619b3460f4b1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:13.339283 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9c45e112-1e53-4184-80d5-30ff6f05bc2e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:13.339977 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9c45e112-1e53-4184-80d5-30ff6f05bc2e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:13.346038 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6dabf65a-a8e3-4d8b-8625-619b3460f4b1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:13.346851 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c45e112-1e53-4184-80d5-30ff6f05bc2e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:13.347923 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c45e112-1e53-4184-80d5-30ff6f05bc2e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:13.348222 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6dabf65a-a8e3-4d8b-8625-619b3460f4b1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:13.348412 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c45e112-1e53-4184-80d5-30ff6f05bc2e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:13.349308 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c45e112-1e53-4184-80d5-30ff6f05bc2e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:13.349435 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6dabf65a-a8e3-4d8b-8625-619b3460f4b1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.160961 Aug 24 09:01:13.349774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c45e112-1e53-4184-80d5-30ff6f05bc2e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:13.349925 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 363/723] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:13 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:13.350291 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9c45e112-1e53-4184-80d5-30ff6f05bc2e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:13.486937 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9c45e112-1e53-4184-80d5-30ff6f05bc2e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:13.495399 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9c45e112-1e53-4184-80d5-30ff6f05bc2e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.159920 Aug 24 09:01:13.495963 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 361/724] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:13 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:14.372988 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e6275a58-4aec-464c-a00a-da63a921b874 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:14.373657 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e6275a58-4aec-464c-a00a-da63a921b874 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:14.379789 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6275a58-4aec-464c-a00a-da63a921b874 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:14.380307 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6275a58-4aec-464c-a00a-da63a921b874 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:14.380737 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6275a58-4aec-464c-a00a-da63a921b874 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:14.381427 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6275a58-4aec-464c-a00a-da63a921b874 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:14.381879 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6275a58-4aec-464c-a00a-da63a921b874 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:14.382298 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e6275a58-4aec-464c-a00a-da63a921b874 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:14.518358 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d62f1be4-5c8e-47fd-8b6a-28f2d5c0fbc3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:14.518808 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d62f1be4-5c8e-47fd-8b6a-28f2d5c0fbc3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:14.520554 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e6275a58-4aec-464c-a00a-da63a921b874 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:14.525583 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d62f1be4-5c8e-47fd-8b6a-28f2d5c0fbc3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:14.526069 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d62f1be4-5c8e-47fd-8b6a-28f2d5c0fbc3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:14.526505 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d62f1be4-5c8e-47fd-8b6a-28f2d5c0fbc3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:14.527206 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d62f1be4-5c8e-47fd-8b6a-28f2d5c0fbc3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:14.527667 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d62f1be4-5c8e-47fd-8b6a-28f2d5c0fbc3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:14.528121 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d62f1be4-5c8e-47fd-8b6a-28f2d5c0fbc3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:14.529082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e6275a58-4aec-464c-a00a-da63a921b874 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:14.530581 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e6275a58-4aec-464c-a00a-da63a921b874 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:14.531735 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e6275a58-4aec-464c-a00a-da63a921b874 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.162933 Aug 24 09:01:14.532323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 364/725] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:14 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:14.665826 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d62f1be4-5c8e-47fd-8b6a-28f2d5c0fbc3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:14.673562 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d62f1be4-5c8e-47fd-8b6a-28f2d5c0fbc3 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.159606 Aug 24 09:01:14.674130 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 362/726] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:14 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:15.560623 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3ff9b189-1402-405b-982d-84c70d501c90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:15.561242 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3ff9b189-1402-405b-982d-84c70d501c90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:15.567736 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ff9b189-1402-405b-982d-84c70d501c90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:15.568259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ff9b189-1402-405b-982d-84c70d501c90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:15.568709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ff9b189-1402-405b-982d-84c70d501c90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:15.569449 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ff9b189-1402-405b-982d-84c70d501c90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:15.569916 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ff9b189-1402-405b-982d-84c70d501c90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:15.570347 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ff9b189-1402-405b-982d-84c70d501c90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:15.695016 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-41fbc2f3-3f9b-432c-b573-0f171394de42 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:15.695738 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-41fbc2f3-3f9b-432c-b573-0f171394de42 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:15.702823 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41fbc2f3-3f9b-432c-b573-0f171394de42 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:15.703224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41fbc2f3-3f9b-432c-b573-0f171394de42 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:15.703756 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41fbc2f3-3f9b-432c-b573-0f171394de42 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:15.704538 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41fbc2f3-3f9b-432c-b573-0f171394de42 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:15.705061 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41fbc2f3-3f9b-432c-b573-0f171394de42 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:15.705549 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41fbc2f3-3f9b-432c-b573-0f171394de42 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:15.709872 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3ff9b189-1402-405b-982d-84c70d501c90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:15.719717 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3ff9b189-1402-405b-982d-84c70d501c90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:15.721301 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3ff9b189-1402-405b-982d-84c70d501c90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:15.723424 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3ff9b189-1402-405b-982d-84c70d501c90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.165759 Aug 24 09:01:15.724010 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 365/727] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:15 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:15.844336 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-41fbc2f3-3f9b-432c-b573-0f171394de42 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:15.853049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-41fbc2f3-3f9b-432c-b573-0f171394de42 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.162319 Aug 24 09:01:15.853634 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 363/728] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:15 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:16.747291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a5f2534b-fd15-4cce-a4bf-6b2e2f32cf34 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:16.747899 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a5f2534b-fd15-4cce-a4bf-6b2e2f32cf34 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:16.754428 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5f2534b-fd15-4cce-a4bf-6b2e2f32cf34 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:16.754917 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5f2534b-fd15-4cce-a4bf-6b2e2f32cf34 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:16.755357 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5f2534b-fd15-4cce-a4bf-6b2e2f32cf34 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:16.756052 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5f2534b-fd15-4cce-a4bf-6b2e2f32cf34 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:16.756533 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5f2534b-fd15-4cce-a4bf-6b2e2f32cf34 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:16.760702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a5f2534b-fd15-4cce-a4bf-6b2e2f32cf34 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:16.777800 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:16.877100 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f9d0bfa5-fd17-4403-bb57-08b5e284bc11 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:16.877827 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f9d0bfa5-fd17-4403-bb57-08b5e284bc11 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:16.888082 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9d0bfa5-fd17-4403-bb57-08b5e284bc11 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:16.889003 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9d0bfa5-fd17-4403-bb57-08b5e284bc11 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:16.889748 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9d0bfa5-fd17-4403-bb57-08b5e284bc11 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:16.890975 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9d0bfa5-fd17-4403-bb57-08b5e284bc11 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:16.891788 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9d0bfa5-fd17-4403-bb57-08b5e284bc11 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:16.892599 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f9d0bfa5-fd17-4403-bb57-08b5e284bc11 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:16.916902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a5f2534b-fd15-4cce-a4bf-6b2e2f32cf34 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:16.927295 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a5f2534b-fd15-4cce-a4bf-6b2e2f32cf34 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:16.928837 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a5f2534b-fd15-4cce-a4bf-6b2e2f32cf34 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:16.930023 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a5f2534b-fd15-4cce-a4bf-6b2e2f32cf34 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.186701 Aug 24 09:01:16.930609 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 366/729] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:16 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:17.039252 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f9d0bfa5-fd17-4403-bb57-08b5e284bc11 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:17.046773 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f9d0bfa5-fd17-4403-bb57-08b5e284bc11 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.173693 Aug 24 09:01:17.047341 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 364/730] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:16 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:17.952324 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5af32f90-abed-4887-bd86-09a69511a7ff tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:17.952931 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5af32f90-abed-4887-bd86-09a69511a7ff tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:17.959411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5af32f90-abed-4887-bd86-09a69511a7ff tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:17.959885 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5af32f90-abed-4887-bd86-09a69511a7ff tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:17.960350 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5af32f90-abed-4887-bd86-09a69511a7ff tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:17.961033 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5af32f90-abed-4887-bd86-09a69511a7ff tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:17.961485 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5af32f90-abed-4887-bd86-09a69511a7ff tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:17.961902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5af32f90-abed-4887-bd86-09a69511a7ff tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:18.068473 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7198d52f-c58b-492e-a866-69f4bdc083cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:18.069188 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7198d52f-c58b-492e-a866-69f4bdc083cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:18.075691 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7198d52f-c58b-492e-a866-69f4bdc083cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:18.076211 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7198d52f-c58b-492e-a866-69f4bdc083cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:18.076656 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7198d52f-c58b-492e-a866-69f4bdc083cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:18.077422 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7198d52f-c58b-492e-a866-69f4bdc083cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:18.077889 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7198d52f-c58b-492e-a866-69f4bdc083cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:18.078309 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7198d52f-c58b-492e-a866-69f4bdc083cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:18.094557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5af32f90-abed-4887-bd86-09a69511a7ff tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:18.104106 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5af32f90-abed-4887-bd86-09a69511a7ff tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:18.105625 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5af32f90-abed-4887-bd86-09a69511a7ff tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:18.106792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5af32f90-abed-4887-bd86-09a69511a7ff tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.158442 Aug 24 09:01:18.107360 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 367/731] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:17 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:18.220046 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7198d52f-c58b-492e-a866-69f4bdc083cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:18.228198 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7198d52f-c58b-492e-a866-69f4bdc083cd tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.163760 Aug 24 09:01:18.228755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 365/732] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:18 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:19.130744 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e7265666-05f2-43a8-a6d5-d42326d0a3c9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:19.131586 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e7265666-05f2-43a8-a6d5-d42326d0a3c9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:19.138213 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7265666-05f2-43a8-a6d5-d42326d0a3c9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:19.138842 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7265666-05f2-43a8-a6d5-d42326d0a3c9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:19.139330 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7265666-05f2-43a8-a6d5-d42326d0a3c9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:19.140259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7265666-05f2-43a8-a6d5-d42326d0a3c9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:19.140889 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7265666-05f2-43a8-a6d5-d42326d0a3c9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:19.141317 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e7265666-05f2-43a8-a6d5-d42326d0a3c9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:19.250635 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-223e06e7-4bb1-4084-95a4-9051c5987ff4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:19.251239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-223e06e7-4bb1-4084-95a4-9051c5987ff4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:19.258760 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-223e06e7-4bb1-4084-95a4-9051c5987ff4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:19.259250 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-223e06e7-4bb1-4084-95a4-9051c5987ff4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:19.259692 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-223e06e7-4bb1-4084-95a4-9051c5987ff4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:19.260424 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-223e06e7-4bb1-4084-95a4-9051c5987ff4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:19.260879 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-223e06e7-4bb1-4084-95a4-9051c5987ff4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:19.261305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-223e06e7-4bb1-4084-95a4-9051c5987ff4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:19.291608 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e7265666-05f2-43a8-a6d5-d42326d0a3c9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:19.300692 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e7265666-05f2-43a8-a6d5-d42326d0a3c9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:19.302318 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e7265666-05f2-43a8-a6d5-d42326d0a3c9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:19.303486 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e7265666-05f2-43a8-a6d5-d42326d0a3c9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.177035 Aug 24 09:01:19.304047 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 368/733] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:19 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:01:19.422121 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-223e06e7-4bb1-4084-95a4-9051c5987ff4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:19.430331 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-223e06e7-4bb1-4084-95a4-9051c5987ff4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.183485 Aug 24 09:01:19.430903 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 366/734] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:19 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:20.327241 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-721d9770-1b8a-4395-b84d-d9d12092a0f6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:20.327815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-721d9770-1b8a-4395-b84d-d9d12092a0f6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:20.334564 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-721d9770-1b8a-4395-b84d-d9d12092a0f6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:20.335050 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-721d9770-1b8a-4395-b84d-d9d12092a0f6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:20.335514 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-721d9770-1b8a-4395-b84d-d9d12092a0f6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:20.336234 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-721d9770-1b8a-4395-b84d-d9d12092a0f6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:20.336692 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-721d9770-1b8a-4395-b84d-d9d12092a0f6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:20.337116 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-721d9770-1b8a-4395-b84d-d9d12092a0f6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:20.452919 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-88583d48-def5-40db-bc03-161397db4577 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:20.454048 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-88583d48-def5-40db-bc03-161397db4577 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:20.461720 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88583d48-def5-40db-bc03-161397db4577 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:20.462312 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88583d48-def5-40db-bc03-161397db4577 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:20.462829 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88583d48-def5-40db-bc03-161397db4577 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:20.463707 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88583d48-def5-40db-bc03-161397db4577 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:20.464298 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88583d48-def5-40db-bc03-161397db4577 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:20.464798 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88583d48-def5-40db-bc03-161397db4577 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:20.483962 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-721d9770-1b8a-4395-b84d-d9d12092a0f6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:20.494038 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-721d9770-1b8a-4395-b84d-d9d12092a0f6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:20.495453 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-721d9770-1b8a-4395-b84d-d9d12092a0f6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:20.496881 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-721d9770-1b8a-4395-b84d-d9d12092a0f6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.173640 Aug 24 09:01:20.500146 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 369/735] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:20 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:20.608921 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-88583d48-def5-40db-bc03-161397db4577 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:20.617959 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-88583d48-def5-40db-bc03-161397db4577 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.170149 Aug 24 09:01:20.618593 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 367/736] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:20 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:21.534936 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-79f763eb-ffe2-4cd2-badb-914793fe68a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:21.535748 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-79f763eb-ffe2-4cd2-badb-914793fe68a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:21.541897 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f763eb-ffe2-4cd2-badb-914793fe68a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:21.542390 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f763eb-ffe2-4cd2-badb-914793fe68a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:21.542827 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f763eb-ffe2-4cd2-badb-914793fe68a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:21.543560 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f763eb-ffe2-4cd2-badb-914793fe68a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:21.544015 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f763eb-ffe2-4cd2-badb-914793fe68a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:21.544481 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79f763eb-ffe2-4cd2-badb-914793fe68a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:21.640271 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-18f25309-893c-4e95-bfc6-3f2eb0b0e32b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:21.640909 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-18f25309-893c-4e95-bfc6-3f2eb0b0e32b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:21.648792 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18f25309-893c-4e95-bfc6-3f2eb0b0e32b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:21.649298 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18f25309-893c-4e95-bfc6-3f2eb0b0e32b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:21.649772 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18f25309-893c-4e95-bfc6-3f2eb0b0e32b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:21.650512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18f25309-893c-4e95-bfc6-3f2eb0b0e32b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:21.650974 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18f25309-893c-4e95-bfc6-3f2eb0b0e32b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:21.651603 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18f25309-893c-4e95-bfc6-3f2eb0b0e32b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:21.682785 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-79f763eb-ffe2-4cd2-badb-914793fe68a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:21.692832 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-79f763eb-ffe2-4cd2-badb-914793fe68a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:21.694428 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-79f763eb-ffe2-4cd2-badb-914793fe68a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:21.695628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-79f763eb-ffe2-4cd2-badb-914793fe68a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.164702 Aug 24 09:01:21.696242 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 370/737] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:21 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:21.799052 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-18f25309-893c-4e95-bfc6-3f2eb0b0e32b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:21.807711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-18f25309-893c-4e95-bfc6-3f2eb0b0e32b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.172372 Aug 24 09:01:21.808319 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 368/738] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:21 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:22.039400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-67b1fd17-25bd-4416-a16b-24bbd658f21b req-186d1759-2ed1-42d4-a743-a5f36a4185a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4866e8f4-ddfe-4cee-8bcc-5db7372926f5", "name": "network-vif-plugged", "status": "completed", "tag": "4e1f25c9-676d-433c-8c1b-ae79e13a1625"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:22.049900 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-67b1fd17-25bd-4416-a16b-24bbd658f21b req-186d1759-2ed1-42d4-a743-a5f36a4185a6 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:22.050383 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-67b1fd17-25bd-4416-a16b-24bbd658f21b req-186d1759-2ed1-42d4-a743-a5f36a4185a6 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:22.051379 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-67b1fd17-25bd-4416-a16b-24bbd658f21b req-186d1759-2ed1-42d4-a743-a5f36a4185a6 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:22.066247 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-67b1fd17-25bd-4416-a16b-24bbd658f21b req-186d1759-2ed1-42d4-a743-a5f36a4185a6 service nova] Creating event network-vif-plugged:4e1f25c9-676d-433c-8c1b-ae79e13a1625 for instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 on hv-cinder-83538 Aug 24 09:01:22.073653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-67b1fd17-25bd-4416-a16b-24bbd658f21b req-186d1759-2ed1-42d4-a743-a5f36a4185a6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038446 Aug 24 09:01:22.075263 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 371/739] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:01:22.722157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8bafbefc-eeac-4668-acac-83984965ee88 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:22.723543 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8bafbefc-eeac-4668-acac-83984965ee88 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:22.729739 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bafbefc-eeac-4668-acac-83984965ee88 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:22.730238 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bafbefc-eeac-4668-acac-83984965ee88 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:22.730677 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bafbefc-eeac-4668-acac-83984965ee88 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:22.731389 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bafbefc-eeac-4668-acac-83984965ee88 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:22.731854 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bafbefc-eeac-4668-acac-83984965ee88 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:22.732339 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8bafbefc-eeac-4668-acac-83984965ee88 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:22.843863 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d91165c1-62fb-4f62-9f73-a06b212d2d36 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:22.844893 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d91165c1-62fb-4f62-9f73-a06b212d2d36 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:22.851860 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d91165c1-62fb-4f62-9f73-a06b212d2d36 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:22.852500 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d91165c1-62fb-4f62-9f73-a06b212d2d36 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:22.853223 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d91165c1-62fb-4f62-9f73-a06b212d2d36 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:22.854179 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d91165c1-62fb-4f62-9f73-a06b212d2d36 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:22.855220 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d91165c1-62fb-4f62-9f73-a06b212d2d36 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:22.856344 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d91165c1-62fb-4f62-9f73-a06b212d2d36 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:22.964332 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8bafbefc-eeac-4668-acac-83984965ee88 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:22.974302 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8bafbefc-eeac-4668-acac-83984965ee88 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:22.975727 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8bafbefc-eeac-4668-acac-83984965ee88 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:22.976959 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8bafbefc-eeac-4668-acac-83984965ee88 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.259434 Aug 24 09:01:22.977512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 369/740] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:22 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:23.019040 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d91165c1-62fb-4f62-9f73-a06b212d2d36 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:23.027132 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d91165c1-62fb-4f62-9f73-a06b212d2d36 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.187872 Aug 24 09:01:23.027698 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 372/741] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:22 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:24.000750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-48008ffa-9ba8-42bb-9888-639f2271b546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:24.001297 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-48008ffa-9ba8-42bb-9888-639f2271b546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:24.008394 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48008ffa-9ba8-42bb-9888-639f2271b546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:24.008886 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48008ffa-9ba8-42bb-9888-639f2271b546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:24.009337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48008ffa-9ba8-42bb-9888-639f2271b546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:24.010021 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48008ffa-9ba8-42bb-9888-639f2271b546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:24.010481 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48008ffa-9ba8-42bb-9888-639f2271b546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:24.010907 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48008ffa-9ba8-42bb-9888-639f2271b546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:24.048323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0f3ba5b6-e248-4c5a-a637-d11011496ae0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:24.048931 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0f3ba5b6-e248-4c5a-a637-d11011496ae0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:24.055094 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3ba5b6-e248-4c5a-a637-d11011496ae0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:24.055847 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3ba5b6-e248-4c5a-a637-d11011496ae0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:24.056327 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3ba5b6-e248-4c5a-a637-d11011496ae0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:24.057033 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3ba5b6-e248-4c5a-a637-d11011496ae0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:24.057482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3ba5b6-e248-4c5a-a637-d11011496ae0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:24.058066 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f3ba5b6-e248-4c5a-a637-d11011496ae0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:24.199397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-48008ffa-9ba8-42bb-9888-639f2271b546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:24.210068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-48008ffa-9ba8-42bb-9888-639f2271b546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:24.211939 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-48008ffa-9ba8-42bb-9888-639f2271b546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:24.213397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-48008ffa-9ba8-42bb-9888-639f2271b546 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.216604 Aug 24 09:01:24.213972 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 370/742] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:23 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:24.219409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b7cbe3d6-0eef-4f5b-a3f4-05e606883762 req-7231415a-6eb3-4f24-8544-151412019ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4056ca-2520-4b9f-8d6f-818005b9a13e", "name": "network-vif-plugged", "status": "completed", "tag": "4e9c44c6-d08e-40f7-8605-73a851811f32"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:24.232232 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b7cbe3d6-0eef-4f5b-a3f4-05e606883762 req-7231415a-6eb3-4f24-8544-151412019ebe service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:24.232937 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b7cbe3d6-0eef-4f5b-a3f4-05e606883762 req-7231415a-6eb3-4f24-8544-151412019ebe service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:24.234070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b7cbe3d6-0eef-4f5b-a3f4-05e606883762 req-7231415a-6eb3-4f24-8544-151412019ebe service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:24.238097 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0f3ba5b6-e248-4c5a-a637-d11011496ae0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:24.247074 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0f3ba5b6-e248-4c5a-a637-d11011496ae0 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.202473 Aug 24 09:01:24.247753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 373/743] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:24 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:24.259781 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b7cbe3d6-0eef-4f5b-a3f4-05e606883762 req-7231415a-6eb3-4f24-8544-151412019ebe service nova] Creating event network-vif-plugged:4e9c44c6-d08e-40f7-8605-73a851811f32 for instance 8c4056ca-2520-4b9f-8d6f-818005b9a13e on hv-cinder-83538 Aug 24 09:01:24.265877 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b7cbe3d6-0eef-4f5b-a3f4-05e606883762 req-7231415a-6eb3-4f24-8544-151412019ebe service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049934 Aug 24 09:01:24.266563 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 371/744] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:01:25.236482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aefd0308-aa95-40cb-b55d-5c7e1a0f283e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:25.237108 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aefd0308-aa95-40cb-b55d-5c7e1a0f283e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:25.244347 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aefd0308-aa95-40cb-b55d-5c7e1a0f283e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:25.248663 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aefd0308-aa95-40cb-b55d-5c7e1a0f283e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:25.248663 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aefd0308-aa95-40cb-b55d-5c7e1a0f283e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:25.248663 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aefd0308-aa95-40cb-b55d-5c7e1a0f283e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:25.248663 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aefd0308-aa95-40cb-b55d-5c7e1a0f283e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:25.249043 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aefd0308-aa95-40cb-b55d-5c7e1a0f283e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:25.273568 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-01c7580a-cb64-4f9f-baf3-b7d0d67558f4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:25.274268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-01c7580a-cb64-4f9f-baf3-b7d0d67558f4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:25.291608 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01c7580a-cb64-4f9f-baf3-b7d0d67558f4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:25.293988 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01c7580a-cb64-4f9f-baf3-b7d0d67558f4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:25.294548 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01c7580a-cb64-4f9f-baf3-b7d0d67558f4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:25.295396 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01c7580a-cb64-4f9f-baf3-b7d0d67558f4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:25.295990 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01c7580a-cb64-4f9f-baf3-b7d0d67558f4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:25.296523 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-01c7580a-cb64-4f9f-baf3-b7d0d67558f4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:25.434240 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-aefd0308-aa95-40cb-b55d-5c7e1a0f283e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:25.445858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-aefd0308-aa95-40cb-b55d-5c7e1a0f283e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:25.448243 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-aefd0308-aa95-40cb-b55d-5c7e1a0f283e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:25.449779 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aefd0308-aa95-40cb-b55d-5c7e1a0f283e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1805 microversion: 2.20 time: 0.217338 Aug 24 09:01:25.450525 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 374/745] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:25 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1805 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:25.506916 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-01c7580a-cb64-4f9f-baf3-b7d0d67558f4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:25.516712 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-01c7580a-cb64-4f9f-baf3-b7d0d67558f4 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.249166 Aug 24 09:01:25.517406 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 372/746] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:25 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:26.475905 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dae06239-cb32-4304-84e7-b6a36ff481ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:26.477252 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dae06239-cb32-4304-84e7-b6a36ff481ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:26.479370 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=66 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:26.485339 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dae06239-cb32-4304-84e7-b6a36ff481ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:26.485834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dae06239-cb32-4304-84e7-b6a36ff481ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:26.486278 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dae06239-cb32-4304-84e7-b6a36ff481ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:26.486986 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dae06239-cb32-4304-84e7-b6a36ff481ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:26.487437 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dae06239-cb32-4304-84e7-b6a36ff481ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:26.487866 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dae06239-cb32-4304-84e7-b6a36ff481ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:26.539094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3b06d811-2224-4408-8bfb-4b15f2d0b890 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:26.539810 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3b06d811-2224-4408-8bfb-4b15f2d0b890 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:26.546481 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b06d811-2224-4408-8bfb-4b15f2d0b890 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:26.546976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b06d811-2224-4408-8bfb-4b15f2d0b890 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:26.547417 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b06d811-2224-4408-8bfb-4b15f2d0b890 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:26.548246 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b06d811-2224-4408-8bfb-4b15f2d0b890 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:26.548723 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b06d811-2224-4408-8bfb-4b15f2d0b890 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:26.549155 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3b06d811-2224-4408-8bfb-4b15f2d0b890 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:26.685898 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-dae06239-cb32-4304-84e7-b6a36ff481ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:26.696262 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-dae06239-cb32-4304-84e7-b6a36ff481ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:26.697850 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-dae06239-cb32-4304-84e7-b6a36ff481ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:26.699079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dae06239-cb32-4304-84e7-b6a36ff481ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1792 microversion: 2.20 time: 0.227915 Aug 24 09:01:26.699637 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 375/747] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:01:26 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1792 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:01:26.744492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3b06d811-2224-4408-8bfb-4b15f2d0b890 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:26.753479 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3b06d811-2224-4408-8bfb-4b15f2d0b890 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1259 microversion: 2.1 time: 0.218438 Aug 24 09:01:26.754543 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 373/748] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:26 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:27.775503 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-37be7d2c-724b-44d6-9c12-57fc1f1d71f5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:27.776162 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-37be7d2c-724b-44d6-9c12-57fc1f1d71f5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:27.782121 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37be7d2c-724b-44d6-9c12-57fc1f1d71f5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:27.782602 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37be7d2c-724b-44d6-9c12-57fc1f1d71f5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:27.783036 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37be7d2c-724b-44d6-9c12-57fc1f1d71f5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:27.783750 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37be7d2c-724b-44d6-9c12-57fc1f1d71f5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:27.784232 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37be7d2c-724b-44d6-9c12-57fc1f1d71f5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:27.784660 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37be7d2c-724b-44d6-9c12-57fc1f1d71f5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:27.921803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-37be7d2c-724b-44d6-9c12-57fc1f1d71f5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:27.930233 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-37be7d2c-724b-44d6-9c12-57fc1f1d71f5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1442 microversion: 2.1 time: 0.158597 Aug 24 09:01:27.930807 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 376/749] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:27 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:27.951407 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f6053566-9e31-4238-89a2-fcbf16411f9b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:27.951813 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f6053566-9e31-4238-89a2-fcbf16411f9b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:27.958907 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6053566-9e31-4238-89a2-fcbf16411f9b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:27.959402 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6053566-9e31-4238-89a2-fcbf16411f9b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:27.959841 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6053566-9e31-4238-89a2-fcbf16411f9b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:27.960576 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6053566-9e31-4238-89a2-fcbf16411f9b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:27.961039 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6053566-9e31-4238-89a2-fcbf16411f9b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:27.961466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f6053566-9e31-4238-89a2-fcbf16411f9b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:28.097218 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f6053566-9e31-4238-89a2-fcbf16411f9b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:28.105694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f6053566-9e31-4238-89a2-fcbf16411f9b tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1442 microversion: 2.1 time: 0.158418 Aug 24 09:01:28.106345 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 374/750] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:27 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:30.027198 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a2f84d28-559e-4711-8f09-521de1e34557 req-b1f6cc5b-f611-4323-8811-dddce8fb1e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4056ca-2520-4b9f-8d6f-818005b9a13e", "tag": "4e9c44c6-d08e-40f7-8605-73a851811f32"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:30.037027 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a2f84d28-559e-4711-8f09-521de1e34557 req-b1f6cc5b-f611-4323-8811-dddce8fb1e9f service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:30.037513 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a2f84d28-559e-4711-8f09-521de1e34557 req-b1f6cc5b-f611-4323-8811-dddce8fb1e9f service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:30.037944 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a2f84d28-559e-4711-8f09-521de1e34557 req-b1f6cc5b-f611-4323-8811-dddce8fb1e9f service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:30.049496 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a2f84d28-559e-4711-8f09-521de1e34557 req-b1f6cc5b-f611-4323-8811-dddce8fb1e9f service nova] Creating event network-changed:4e9c44c6-d08e-40f7-8605-73a851811f32 for instance 8c4056ca-2520-4b9f-8d6f-818005b9a13e on hv-cinder-83538 Aug 24 09:01:30.055034 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a2f84d28-559e-4711-8f09-521de1e34557 req-b1f6cc5b-f611-4323-8811-dddce8fb1e9f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199580 Aug 24 09:01:30.055701 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 377/751] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:01:35.973811 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1db8de51-fe19-40fb-afd2-d6ba07c7bb7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3e0a802-0323-4fb2-874e-f8597b29e42c"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:35.978295 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1db8de51-fe19-40fb-afd2-d6ba07c7bb7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:35.985293 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1db8de51-fe19-40fb-afd2-d6ba07c7bb7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:35.985780 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1db8de51-fe19-40fb-afd2-d6ba07c7bb7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:35.986218 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1db8de51-fe19-40fb-afd2-d6ba07c7bb7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:35.986910 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1db8de51-fe19-40fb-afd2-d6ba07c7bb7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:35.987362 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1db8de51-fe19-40fb-afd2-d6ba07c7bb7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:35.987812 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1db8de51-fe19-40fb-afd2-d6ba07c7bb7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:35.991700 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:36.239016 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1db8de51-fe19-40fb-afd2-d6ba07c7bb7a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "POST /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375191 Aug 24 09:01:36.239621 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 375/752] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 24 09:01:35 2022] POST /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:01:36.609294 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c1ad0921-4208-4031-9dfb-a609483311d3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:36.609883 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c1ad0921-4208-4031-9dfb-a609483311d3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:36.616746 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1ad0921-4208-4031-9dfb-a609483311d3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:36.617231 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1ad0921-4208-4031-9dfb-a609483311d3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:36.617667 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1ad0921-4208-4031-9dfb-a609483311d3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:36.618368 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1ad0921-4208-4031-9dfb-a609483311d3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:36.618816 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1ad0921-4208-4031-9dfb-a609483311d3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:36.619240 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c1ad0921-4208-4031-9dfb-a609483311d3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:36.743840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-c1ad0921-4208-4031-9dfb-a609483311d3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lazy-loading 'services' on Instance uuid 2489f27e-e91b-4e45-8072-7b4226f576f8 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:01:36.858952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c1ad0921-4208-4031-9dfb-a609483311d3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/os-volume_attachments/f1324846-eb4b-441b-8bd1-e5dd960979f2" status: 202 len: 0 microversion: 2.1 time: 0.353967 Aug 24 09:01:36.859544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 378/753] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 24 09:01:36 2022] DELETE /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/os-volume_attachments/f1324846-eb4b-441b-8bd1-e5dd960979f2 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:01:43.777110 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-27168490-949c-40a8-8186-917b0fde29cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:43.779480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-27168490-949c-40a8-8186-917b0fde29cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:43.782025 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=38 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:43.787454 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27168490-949c-40a8-8186-917b0fde29cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:43.787942 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27168490-949c-40a8-8186-917b0fde29cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:43.789097 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27168490-949c-40a8-8186-917b0fde29cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:43.790164 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27168490-949c-40a8-8186-917b0fde29cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:43.790880 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27168490-949c-40a8-8186-917b0fde29cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:43.791319 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27168490-949c-40a8-8186-917b0fde29cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:43.813905 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-27168490-949c-40a8-8186-917b0fde29cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lazy-loading 'flavor' on Instance uuid e46c8263-fe1c-4e13-92a9-038085ee9ed8 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:01:43.941169 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-27168490-949c-40a8-8186-917b0fde29cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "POST /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/action" status: 200 len: 32 microversion: 2.1 time: 0.169008 Aug 24 09:01:43.941696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 376/754] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 24 09:01:43 2022] POST /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:01:43.952827 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-07972bb2-6de7-43f1-a4b8-f38f43432243 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:43.953619 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-07972bb2-6de7-43f1-a4b8-f38f43432243 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:43.961263 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07972bb2-6de7-43f1-a4b8-f38f43432243 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:43.961263 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07972bb2-6de7-43f1-a4b8-f38f43432243 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:43.961742 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07972bb2-6de7-43f1-a4b8-f38f43432243 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:43.962704 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07972bb2-6de7-43f1-a4b8-f38f43432243 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:43.963170 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07972bb2-6de7-43f1-a4b8-f38f43432243 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:43.963600 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-07972bb2-6de7-43f1-a4b8-f38f43432243 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:44.339816 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-087f8367-af86-4761-be01-f5b936d88b43 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:01:44.346479 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-087f8367-af86-4761-be01-f5b936d88b43 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:44.346967 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-087f8367-af86-4761-be01-f5b936d88b43 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:44.347401 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-087f8367-af86-4761-be01-f5b936d88b43 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:44.371353 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-087f8367-af86-4761-be01-f5b936d88b43 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Going to try to stop instance {{(pid=120543) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 09:01:44.419398 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-087f8367-af86-4761-be01-f5b936d88b43 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "POST /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/action" status: 202 len: 0 microversion: 2.1 time: 0.084266 Aug 24 09:01:44.420045 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 377/755] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 24 09:01:44 2022] POST /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:01:44.428373 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-13d16139-ce0a-42b1-a1f9-d6fe66cd8360 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:44.429611 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-13d16139-ce0a-42b1-a1f9-d6fe66cd8360 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:44.435984 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13d16139-ce0a-42b1-a1f9-d6fe66cd8360 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:44.436528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13d16139-ce0a-42b1-a1f9-d6fe66cd8360 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:44.436976 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13d16139-ce0a-42b1-a1f9-d6fe66cd8360 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:44.437695 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13d16139-ce0a-42b1-a1f9-d6fe66cd8360 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:44.438165 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13d16139-ce0a-42b1-a1f9-d6fe66cd8360 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:44.438567 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-13d16139-ce0a-42b1-a1f9-d6fe66cd8360 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:44.451355 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-07972bb2-6de7-43f1-a4b8-f38f43432243 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:44.460759 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-07972bb2-6de7-43f1-a4b8-f38f43432243 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.512109 Aug 24 09:01:44.461505 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 379/756] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:43 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:44.624542 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-13d16139-ce0a-42b1-a1f9-d6fe66cd8360 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:44.632484 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-13d16139-ce0a-42b1-a1f9-d6fe66cd8360 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.208005 Aug 24 09:01:44.633048 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 378/757] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:44 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:45.482672 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0141d9c5-1e3c-43ec-8c2e-b4f3ae593af3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:45.483275 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0141d9c5-1e3c-43ec-8c2e-b4f3ae593af3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:45.489224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0141d9c5-1e3c-43ec-8c2e-b4f3ae593af3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:45.489704 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0141d9c5-1e3c-43ec-8c2e-b4f3ae593af3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:45.490150 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0141d9c5-1e3c-43ec-8c2e-b4f3ae593af3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:45.490811 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0141d9c5-1e3c-43ec-8c2e-b4f3ae593af3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:45.491260 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0141d9c5-1e3c-43ec-8c2e-b4f3ae593af3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:45.491681 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0141d9c5-1e3c-43ec-8c2e-b4f3ae593af3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:45.627240 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0141d9c5-1e3c-43ec-8c2e-b4f3ae593af3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:45.636169 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0141d9c5-1e3c-43ec-8c2e-b4f3ae593af3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.157317 Aug 24 09:01:45.636772 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 380/758] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:45 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:45.655070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f1c64a60-46f2-40e0-bc72-28af6ebbec03 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:45.655684 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f1c64a60-46f2-40e0-bc72-28af6ebbec03 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:45.662084 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c64a60-46f2-40e0-bc72-28af6ebbec03 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:45.662572 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c64a60-46f2-40e0-bc72-28af6ebbec03 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:45.663009 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c64a60-46f2-40e0-bc72-28af6ebbec03 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:45.663732 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c64a60-46f2-40e0-bc72-28af6ebbec03 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:45.664342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c64a60-46f2-40e0-bc72-28af6ebbec03 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:45.664775 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f1c64a60-46f2-40e0-bc72-28af6ebbec03 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:45.795283 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f1c64a60-46f2-40e0-bc72-28af6ebbec03 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:45.802943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f1c64a60-46f2-40e0-bc72-28af6ebbec03 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.151868 Aug 24 09:01:45.803498 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 379/759] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:45 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:46.657198 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a3145b80-9935-484b-b29e-9a0714f02811 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:46.657802 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a3145b80-9935-484b-b29e-9a0714f02811 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:46.663744 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3145b80-9935-484b-b29e-9a0714f02811 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:46.664257 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3145b80-9935-484b-b29e-9a0714f02811 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:46.664691 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3145b80-9935-484b-b29e-9a0714f02811 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:46.665936 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3145b80-9935-484b-b29e-9a0714f02811 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:46.666389 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3145b80-9935-484b-b29e-9a0714f02811 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:46.666812 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3145b80-9935-484b-b29e-9a0714f02811 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:46.801403 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a3145b80-9935-484b-b29e-9a0714f02811 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:46.803689 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:46.811194 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a3145b80-9935-484b-b29e-9a0714f02811 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.157750 Aug 24 09:01:46.811759 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 381/760] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:46 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:46.824455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-742c20ff-a7c3-4b95-9cd1-f61eaf208bdc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:46.825070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-742c20ff-a7c3-4b95-9cd1-f61eaf208bdc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:46.831515 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-742c20ff-a7c3-4b95-9cd1-f61eaf208bdc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:46.832003 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-742c20ff-a7c3-4b95-9cd1-f61eaf208bdc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:46.832476 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-742c20ff-a7c3-4b95-9cd1-f61eaf208bdc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:46.833169 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-742c20ff-a7c3-4b95-9cd1-f61eaf208bdc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:46.833624 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-742c20ff-a7c3-4b95-9cd1-f61eaf208bdc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:46.834058 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-742c20ff-a7c3-4b95-9cd1-f61eaf208bdc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:46.963574 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-742c20ff-a7c3-4b95-9cd1-f61eaf208bdc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:46.971249 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-742c20ff-a7c3-4b95-9cd1-f61eaf208bdc tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.150721 Aug 24 09:01:46.971805 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 380/761] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:46 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:47.832964 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b3119dab-58bc-44bc-9eee-5128c54da06f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:47.833578 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b3119dab-58bc-44bc-9eee-5128c54da06f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:47.839742 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3119dab-58bc-44bc-9eee-5128c54da06f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:47.840255 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3119dab-58bc-44bc-9eee-5128c54da06f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:47.840700 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3119dab-58bc-44bc-9eee-5128c54da06f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:47.841394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3119dab-58bc-44bc-9eee-5128c54da06f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:47.841857 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3119dab-58bc-44bc-9eee-5128c54da06f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:47.842292 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b3119dab-58bc-44bc-9eee-5128c54da06f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:47.977612 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b3119dab-58bc-44bc-9eee-5128c54da06f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:47.985836 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b3119dab-58bc-44bc-9eee-5128c54da06f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.157067 Aug 24 09:01:47.986584 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 382/762] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:47 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:47.991954 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d594daf-ae0c-43fa-8e9e-ab428dd9e1d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:47.992613 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d594daf-ae0c-43fa-8e9e-ab428dd9e1d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:47.999103 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d594daf-ae0c-43fa-8e9e-ab428dd9e1d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:47.999531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d594daf-ae0c-43fa-8e9e-ab428dd9e1d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:48.000011 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d594daf-ae0c-43fa-8e9e-ab428dd9e1d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:48.000707 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d594daf-ae0c-43fa-8e9e-ab428dd9e1d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:48.001167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d594daf-ae0c-43fa-8e9e-ab428dd9e1d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:48.001593 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d594daf-ae0c-43fa-8e9e-ab428dd9e1d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:48.144981 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0d594daf-ae0c-43fa-8e9e-ab428dd9e1d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:48.153239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d594daf-ae0c-43fa-8e9e-ab428dd9e1d1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.165065 Aug 24 09:01:48.153813 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 381/763] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:47 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:49.008680 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e8c88818-73e6-4a1a-8057-19a6fe25f98e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:49.009625 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e8c88818-73e6-4a1a-8057-19a6fe25f98e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:49.015970 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8c88818-73e6-4a1a-8057-19a6fe25f98e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:49.016496 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8c88818-73e6-4a1a-8057-19a6fe25f98e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:49.016931 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8c88818-73e6-4a1a-8057-19a6fe25f98e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:49.017629 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8c88818-73e6-4a1a-8057-19a6fe25f98e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:49.018083 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8c88818-73e6-4a1a-8057-19a6fe25f98e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:49.018507 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e8c88818-73e6-4a1a-8057-19a6fe25f98e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:49.173752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3cdc6b2b-7de8-41eb-961a-17029047cd12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:49.174258 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e8c88818-73e6-4a1a-8057-19a6fe25f98e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:49.174397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3cdc6b2b-7de8-41eb-961a-17029047cd12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:49.181911 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cdc6b2b-7de8-41eb-961a-17029047cd12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:49.182398 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cdc6b2b-7de8-41eb-961a-17029047cd12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:49.182836 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cdc6b2b-7de8-41eb-961a-17029047cd12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:49.183540 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cdc6b2b-7de8-41eb-961a-17029047cd12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:49.183883 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e8c88818-73e6-4a1a-8057-19a6fe25f98e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.180695 Aug 24 09:01:49.183988 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cdc6b2b-7de8-41eb-961a-17029047cd12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:49.184707 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cdc6b2b-7de8-41eb-961a-17029047cd12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:49.184832 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 383/764] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:49 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:49.331677 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3cdc6b2b-7de8-41eb-961a-17029047cd12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:49.341538 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3cdc6b2b-7de8-41eb-961a-17029047cd12 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.171631 Aug 24 09:01:49.342115 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 382/765] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:49 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:01:50.204761 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e13040f5-d100-42da-a864-17b90a7d82e3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:50.205365 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e13040f5-d100-42da-a864-17b90a7d82e3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:50.211229 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e13040f5-d100-42da-a864-17b90a7d82e3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:50.211706 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e13040f5-d100-42da-a864-17b90a7d82e3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:50.212271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e13040f5-d100-42da-a864-17b90a7d82e3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:50.212846 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e13040f5-d100-42da-a864-17b90a7d82e3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:50.213296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e13040f5-d100-42da-a864-17b90a7d82e3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:50.213715 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e13040f5-d100-42da-a864-17b90a7d82e3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:50.341245 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e13040f5-d100-42da-a864-17b90a7d82e3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:50.349404 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e13040f5-d100-42da-a864-17b90a7d82e3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.148506 Aug 24 09:01:50.349975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 384/766] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:50 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:50.362731 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-90717c5b-febf-452b-86ca-2a9049d212cd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:50.363375 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-90717c5b-febf-452b-86ca-2a9049d212cd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:50.369831 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90717c5b-febf-452b-86ca-2a9049d212cd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:50.370317 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90717c5b-febf-452b-86ca-2a9049d212cd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:50.370753 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90717c5b-febf-452b-86ca-2a9049d212cd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:50.371444 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90717c5b-febf-452b-86ca-2a9049d212cd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:50.371901 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90717c5b-febf-452b-86ca-2a9049d212cd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:50.372354 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-90717c5b-febf-452b-86ca-2a9049d212cd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:50.513430 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-90717c5b-febf-452b-86ca-2a9049d212cd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:50.521276 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-90717c5b-febf-452b-86ca-2a9049d212cd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.162490 Aug 24 09:01:50.521837 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 383/767] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:50 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:51.372194 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4c043c32-e3a8-41e3-b252-8dfc77470972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:51.372808 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4c043c32-e3a8-41e3-b252-8dfc77470972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:51.378734 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c043c32-e3a8-41e3-b252-8dfc77470972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:51.379223 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c043c32-e3a8-41e3-b252-8dfc77470972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:51.379668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c043c32-e3a8-41e3-b252-8dfc77470972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:51.380417 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c043c32-e3a8-41e3-b252-8dfc77470972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:51.380922 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c043c32-e3a8-41e3-b252-8dfc77470972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:51.381349 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c043c32-e3a8-41e3-b252-8dfc77470972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:51.511319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-4c043c32-e3a8-41e3-b252-8dfc77470972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:51.519776 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4c043c32-e3a8-41e3-b252-8dfc77470972 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.152167 Aug 24 09:01:51.520368 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 385/768] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:51 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:51.542899 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f25db95d-4859-431d-9073-a2372eb56983 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:51.543511 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f25db95d-4859-431d-9073-a2372eb56983 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:51.549983 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f25db95d-4859-431d-9073-a2372eb56983 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:51.550414 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f25db95d-4859-431d-9073-a2372eb56983 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:51.550851 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f25db95d-4859-431d-9073-a2372eb56983 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:51.551597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f25db95d-4859-431d-9073-a2372eb56983 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:51.552009 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f25db95d-4859-431d-9073-a2372eb56983 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:51.552467 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f25db95d-4859-431d-9073-a2372eb56983 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:51.681987 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f25db95d-4859-431d-9073-a2372eb56983 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:51.689791 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f25db95d-4859-431d-9073-a2372eb56983 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.151308 Aug 24 09:01:51.690356 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 384/769] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:51 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:52.540840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2e64412a-d044-4f04-b9bd-2b1d8372cdb1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:52.541478 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2e64412a-d044-4f04-b9bd-2b1d8372cdb1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:52.547418 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e64412a-d044-4f04-b9bd-2b1d8372cdb1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:52.547906 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e64412a-d044-4f04-b9bd-2b1d8372cdb1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:52.548390 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e64412a-d044-4f04-b9bd-2b1d8372cdb1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:52.549091 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e64412a-d044-4f04-b9bd-2b1d8372cdb1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:52.549553 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e64412a-d044-4f04-b9bd-2b1d8372cdb1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:52.549980 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e64412a-d044-4f04-b9bd-2b1d8372cdb1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:52.681905 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2e64412a-d044-4f04-b9bd-2b1d8372cdb1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:52.690541 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2e64412a-d044-4f04-b9bd-2b1d8372cdb1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.153614 Aug 24 09:01:52.691096 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 386/770] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:52 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:52.710666 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e8a1c1a2-ada1-457e-b0c5-e5732186bd77 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:52.711314 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e8a1c1a2-ada1-457e-b0c5-e5732186bd77 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:52.722484 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8a1c1a2-ada1-457e-b0c5-e5732186bd77 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:52.723360 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8a1c1a2-ada1-457e-b0c5-e5732186bd77 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:52.724021 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8a1c1a2-ada1-457e-b0c5-e5732186bd77 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:52.724761 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8a1c1a2-ada1-457e-b0c5-e5732186bd77 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:52.725225 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8a1c1a2-ada1-457e-b0c5-e5732186bd77 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:52.725655 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e8a1c1a2-ada1-457e-b0c5-e5732186bd77 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:52.858142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e8a1c1a2-ada1-457e-b0c5-e5732186bd77 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:52.865906 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e8a1c1a2-ada1-457e-b0c5-e5732186bd77 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.159141 Aug 24 09:01:52.866473 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 385/771] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:52 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:53.713185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-17265bd8-addd-417b-8aa7-69caa2fdcd27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:53.713789 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-17265bd8-addd-417b-8aa7-69caa2fdcd27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:53.720382 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17265bd8-addd-417b-8aa7-69caa2fdcd27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:53.721080 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17265bd8-addd-417b-8aa7-69caa2fdcd27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:53.721698 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17265bd8-addd-417b-8aa7-69caa2fdcd27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:53.722744 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17265bd8-addd-417b-8aa7-69caa2fdcd27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:53.723218 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17265bd8-addd-417b-8aa7-69caa2fdcd27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:53.723658 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-17265bd8-addd-417b-8aa7-69caa2fdcd27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:53.855547 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-17265bd8-addd-417b-8aa7-69caa2fdcd27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:53.863939 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-17265bd8-addd-417b-8aa7-69caa2fdcd27 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.155354 Aug 24 09:01:53.864533 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 387/772] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:53 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:53.887615 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-64cb3d9a-3f74-4ea8-a100-dc24a523dabb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:53.888252 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-64cb3d9a-3f74-4ea8-a100-dc24a523dabb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:53.894992 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64cb3d9a-3f74-4ea8-a100-dc24a523dabb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:53.895474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64cb3d9a-3f74-4ea8-a100-dc24a523dabb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:53.895914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64cb3d9a-3f74-4ea8-a100-dc24a523dabb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:53.896735 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64cb3d9a-3f74-4ea8-a100-dc24a523dabb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:53.897198 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64cb3d9a-3f74-4ea8-a100-dc24a523dabb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:53.897624 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64cb3d9a-3f74-4ea8-a100-dc24a523dabb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:54.030946 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-64cb3d9a-3f74-4ea8-a100-dc24a523dabb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:54.038640 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-64cb3d9a-3f74-4ea8-a100-dc24a523dabb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.155293 Aug 24 09:01:54.039192 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 386/773] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:53 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:54.885156 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c5d601e8-efff-4545-a554-9eb1e8ee4ff3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:54.885760 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c5d601e8-efff-4545-a554-9eb1e8ee4ff3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:54.892108 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5d601e8-efff-4545-a554-9eb1e8ee4ff3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:54.892608 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5d601e8-efff-4545-a554-9eb1e8ee4ff3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:54.893052 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5d601e8-efff-4545-a554-9eb1e8ee4ff3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:54.893751 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5d601e8-efff-4545-a554-9eb1e8ee4ff3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:54.894216 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5d601e8-efff-4545-a554-9eb1e8ee4ff3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:54.894645 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5d601e8-efff-4545-a554-9eb1e8ee4ff3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:55.026933 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c5d601e8-efff-4545-a554-9eb1e8ee4ff3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:55.035016 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c5d601e8-efff-4545-a554-9eb1e8ee4ff3 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.153903 Aug 24 09:01:55.035578 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 388/774] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:54 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:55.060238 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-432b09da-75fa-4b3d-9324-118ca93a4bc0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:55.060857 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-432b09da-75fa-4b3d-9324-118ca93a4bc0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:55.067308 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-432b09da-75fa-4b3d-9324-118ca93a4bc0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:55.067795 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-432b09da-75fa-4b3d-9324-118ca93a4bc0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:55.068267 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-432b09da-75fa-4b3d-9324-118ca93a4bc0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:55.068964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-432b09da-75fa-4b3d-9324-118ca93a4bc0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:55.069425 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-432b09da-75fa-4b3d-9324-118ca93a4bc0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:55.069851 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-432b09da-75fa-4b3d-9324-118ca93a4bc0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:55.088631 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:55.202584 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-432b09da-75fa-4b3d-9324-118ca93a4bc0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:55.210297 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-432b09da-75fa-4b3d-9324-118ca93a4bc0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.154289 Aug 24 09:01:55.210859 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 387/775] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:55 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:56.057160 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d711b1d3-fbb2-42d8-907c-f08e3966c69a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:56.057713 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d711b1d3-fbb2-42d8-907c-f08e3966c69a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:56.064378 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d711b1d3-fbb2-42d8-907c-f08e3966c69a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:56.064871 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d711b1d3-fbb2-42d8-907c-f08e3966c69a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:56.065310 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d711b1d3-fbb2-42d8-907c-f08e3966c69a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:56.066013 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d711b1d3-fbb2-42d8-907c-f08e3966c69a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:56.066473 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d711b1d3-fbb2-42d8-907c-f08e3966c69a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:56.066898 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d711b1d3-fbb2-42d8-907c-f08e3966c69a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:56.201151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d711b1d3-fbb2-42d8-907c-f08e3966c69a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:56.209416 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d711b1d3-fbb2-42d8-907c-f08e3966c69a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.156839 Aug 24 09:01:56.209984 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 389/776] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:56 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:56.232544 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d8619326-268d-40b3-a60f-0417d3c5471e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:56.233160 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d8619326-268d-40b3-a60f-0417d3c5471e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:56.239741 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8619326-268d-40b3-a60f-0417d3c5471e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:56.240263 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8619326-268d-40b3-a60f-0417d3c5471e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:56.240732 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8619326-268d-40b3-a60f-0417d3c5471e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:56.241399 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8619326-268d-40b3-a60f-0417d3c5471e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:56.241856 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8619326-268d-40b3-a60f-0417d3c5471e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:56.242282 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8619326-268d-40b3-a60f-0417d3c5471e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:56.379227 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d8619326-268d-40b3-a60f-0417d3c5471e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:56.387567 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d8619326-268d-40b3-a60f-0417d3c5471e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.159472 Aug 24 09:01:56.388149 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 388/777] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:56 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:57.230731 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-88af2845-c6d3-4a3e-ba28-e703fde3a483 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:57.231348 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-88af2845-c6d3-4a3e-ba28-e703fde3a483 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:57.233346 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=30 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:57.238690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88af2845-c6d3-4a3e-ba28-e703fde3a483 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:57.239172 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88af2845-c6d3-4a3e-ba28-e703fde3a483 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:57.239633 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88af2845-c6d3-4a3e-ba28-e703fde3a483 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:57.240351 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88af2845-c6d3-4a3e-ba28-e703fde3a483 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:57.240804 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88af2845-c6d3-4a3e-ba28-e703fde3a483 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:57.241223 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-88af2845-c6d3-4a3e-ba28-e703fde3a483 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:57.371676 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-88af2845-c6d3-4a3e-ba28-e703fde3a483 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:57.379929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-88af2845-c6d3-4a3e-ba28-e703fde3a483 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.153117 Aug 24 09:01:57.380519 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 390/778] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:57 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:57.408927 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0a334a99-2477-4b16-9626-e0a45edde1be tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:57.409562 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0a334a99-2477-4b16-9626-e0a45edde1be tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:57.416542 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a334a99-2477-4b16-9626-e0a45edde1be tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:57.417026 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a334a99-2477-4b16-9626-e0a45edde1be tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:57.417454 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a334a99-2477-4b16-9626-e0a45edde1be tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:57.418152 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a334a99-2477-4b16-9626-e0a45edde1be tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:57.418832 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a334a99-2477-4b16-9626-e0a45edde1be tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:57.419298 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a334a99-2477-4b16-9626-e0a45edde1be tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:57.557215 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0a334a99-2477-4b16-9626-e0a45edde1be tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:57.565098 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0a334a99-2477-4b16-9626-e0a45edde1be tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.160028 Aug 24 09:01:57.565685 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 389/779] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:57 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:58.402628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6941b1d9-9607-4c97-bf21-63b8f9af6889 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:58.403240 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6941b1d9-9607-4c97-bf21-63b8f9af6889 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:58.409294 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6941b1d9-9607-4c97-bf21-63b8f9af6889 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:58.409780 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6941b1d9-9607-4c97-bf21-63b8f9af6889 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:58.410220 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6941b1d9-9607-4c97-bf21-63b8f9af6889 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:58.410923 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6941b1d9-9607-4c97-bf21-63b8f9af6889 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:58.411383 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6941b1d9-9607-4c97-bf21-63b8f9af6889 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:58.411814 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6941b1d9-9607-4c97-bf21-63b8f9af6889 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:58.541161 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6941b1d9-9607-4c97-bf21-63b8f9af6889 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:58.549324 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6941b1d9-9607-4c97-bf21-63b8f9af6889 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.151324 Aug 24 09:01:58.549888 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 391/780] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:58 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:58.585930 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b0fdce31-ddda-4c32-887b-30ca47ba0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:58.586545 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b0fdce31-ddda-4c32-887b-30ca47ba0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:58.592973 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0fdce31-ddda-4c32-887b-30ca47ba0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:58.593464 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0fdce31-ddda-4c32-887b-30ca47ba0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:58.593902 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0fdce31-ddda-4c32-887b-30ca47ba0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:58.594597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0fdce31-ddda-4c32-887b-30ca47ba0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:58.595068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0fdce31-ddda-4c32-887b-30ca47ba0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:58.595486 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b0fdce31-ddda-4c32-887b-30ca47ba0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:58.727536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b0fdce31-ddda-4c32-887b-30ca47ba0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:58.735444 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b0fdce31-ddda-4c32-887b-30ca47ba0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.153399 Aug 24 09:01:58.736000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 390/781] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:58 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:59.571042 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-baf1c6c0-efed-4054-b8ab-9fe88b509a35 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:59.571681 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-baf1c6c0-efed-4054-b8ab-9fe88b509a35 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:59.578521 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baf1c6c0-efed-4054-b8ab-9fe88b509a35 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:59.579120 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baf1c6c0-efed-4054-b8ab-9fe88b509a35 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:59.579650 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baf1c6c0-efed-4054-b8ab-9fe88b509a35 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:59.580383 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baf1c6c0-efed-4054-b8ab-9fe88b509a35 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:59.580852 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baf1c6c0-efed-4054-b8ab-9fe88b509a35 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:59.581282 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-baf1c6c0-efed-4054-b8ab-9fe88b509a35 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:59.713993 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-baf1c6c0-efed-4054-b8ab-9fe88b509a35 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:59.723061 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-baf1c6c0-efed-4054-b8ab-9fe88b509a35 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.156049 Aug 24 09:01:59.723679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 392/782] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:59 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:01:59.756932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-67a5ad30-c70b-46bd-8326-867f04c89c71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:01:59.757544 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-67a5ad30-c70b-46bd-8326-867f04c89c71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:01:59.764917 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67a5ad30-c70b-46bd-8326-867f04c89c71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:59.765402 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67a5ad30-c70b-46bd-8326-867f04c89c71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:59.765839 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67a5ad30-c70b-46bd-8326-867f04c89c71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:59.766780 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67a5ad30-c70b-46bd-8326-867f04c89c71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:01:59.767237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67a5ad30-c70b-46bd-8326-867f04c89c71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:01:59.767659 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-67a5ad30-c70b-46bd-8326-867f04c89c71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:01:59.896443 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-67a5ad30-c70b-46bd-8326-867f04c89c71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:01:59.904146 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-67a5ad30-c70b-46bd-8326-867f04c89c71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.151160 Aug 24 09:01:59.904712 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 391/783] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:01:59 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:00.744628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-47d903df-41ca-44cb-a54a-e2e55465f22a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:00.745269 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-47d903df-41ca-44cb-a54a-e2e55465f22a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:00.751257 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47d903df-41ca-44cb-a54a-e2e55465f22a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:00.751743 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47d903df-41ca-44cb-a54a-e2e55465f22a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:00.752206 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47d903df-41ca-44cb-a54a-e2e55465f22a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:00.752905 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47d903df-41ca-44cb-a54a-e2e55465f22a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:00.753361 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47d903df-41ca-44cb-a54a-e2e55465f22a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:00.753812 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47d903df-41ca-44cb-a54a-e2e55465f22a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:00.886936 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-47d903df-41ca-44cb-a54a-e2e55465f22a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:00.895447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-47d903df-41ca-44cb-a54a-e2e55465f22a tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.154710 Aug 24 09:02:00.896016 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 393/784] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:00 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:00.926136 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f31f52da-64c5-4852-8cee-1aeaae470f64 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:00.926881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f31f52da-64c5-4852-8cee-1aeaae470f64 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:00.933817 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f31f52da-64c5-4852-8cee-1aeaae470f64 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:00.934305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f31f52da-64c5-4852-8cee-1aeaae470f64 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:00.934749 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f31f52da-64c5-4852-8cee-1aeaae470f64 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:00.935449 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f31f52da-64c5-4852-8cee-1aeaae470f64 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:00.935907 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f31f52da-64c5-4852-8cee-1aeaae470f64 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:00.936362 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f31f52da-64c5-4852-8cee-1aeaae470f64 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:01.065280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f31f52da-64c5-4852-8cee-1aeaae470f64 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:01.073736 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f31f52da-64c5-4852-8cee-1aeaae470f64 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.151503 Aug 24 09:02:01.074295 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 392/785] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:00 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:01.917069 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7b46bb09-ed9b-492e-aaa5-170006bf8fe7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:01.917680 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7b46bb09-ed9b-492e-aaa5-170006bf8fe7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:01.923673 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b46bb09-ed9b-492e-aaa5-170006bf8fe7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:01.924191 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b46bb09-ed9b-492e-aaa5-170006bf8fe7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:01.924638 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b46bb09-ed9b-492e-aaa5-170006bf8fe7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:01.925324 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b46bb09-ed9b-492e-aaa5-170006bf8fe7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:01.925779 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b46bb09-ed9b-492e-aaa5-170006bf8fe7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:01.926202 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7b46bb09-ed9b-492e-aaa5-170006bf8fe7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:02.057721 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7b46bb09-ed9b-492e-aaa5-170006bf8fe7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:02.065951 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7b46bb09-ed9b-492e-aaa5-170006bf8fe7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.153077 Aug 24 09:02:02.066526 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 394/786] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:01 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:02.095193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0a91b294-d386-4dc0-af87-0d4dcea8a6c4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:02.095851 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0a91b294-d386-4dc0-af87-0d4dcea8a6c4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:02.102311 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a91b294-d386-4dc0-af87-0d4dcea8a6c4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:02.102795 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a91b294-d386-4dc0-af87-0d4dcea8a6c4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:02.103229 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a91b294-d386-4dc0-af87-0d4dcea8a6c4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:02.104316 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a91b294-d386-4dc0-af87-0d4dcea8a6c4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:02.104785 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a91b294-d386-4dc0-af87-0d4dcea8a6c4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:02.105211 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0a91b294-d386-4dc0-af87-0d4dcea8a6c4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:02.236979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0a91b294-d386-4dc0-af87-0d4dcea8a6c4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:02.244734 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0a91b294-d386-4dc0-af87-0d4dcea8a6c4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.153528 Aug 24 09:02:02.245294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 393/787] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:02 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:03.086865 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ac3d58d1-ed29-4a12-86e1-0812677ce68e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:03.087475 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ac3d58d1-ed29-4a12-86e1-0812677ce68e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:03.094390 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac3d58d1-ed29-4a12-86e1-0812677ce68e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:03.094882 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac3d58d1-ed29-4a12-86e1-0812677ce68e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:03.095319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac3d58d1-ed29-4a12-86e1-0812677ce68e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:03.096053 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac3d58d1-ed29-4a12-86e1-0812677ce68e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:03.096567 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac3d58d1-ed29-4a12-86e1-0812677ce68e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:03.096959 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ac3d58d1-ed29-4a12-86e1-0812677ce68e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:03.235137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ac3d58d1-ed29-4a12-86e1-0812677ce68e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:03.243628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ac3d58d1-ed29-4a12-86e1-0812677ce68e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.160677 Aug 24 09:02:03.244521 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 395/788] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:03 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:03.265655 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-51e9c688-c996-43fd-930e-c9588e973ece tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:03.266268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-51e9c688-c996-43fd-930e-c9588e973ece tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:03.272939 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51e9c688-c996-43fd-930e-c9588e973ece tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:03.273451 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51e9c688-c996-43fd-930e-c9588e973ece tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:03.273884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51e9c688-c996-43fd-930e-c9588e973ece tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:03.274576 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51e9c688-c996-43fd-930e-c9588e973ece tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:03.275037 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51e9c688-c996-43fd-930e-c9588e973ece tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:03.275984 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-51e9c688-c996-43fd-930e-c9588e973ece tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:03.405052 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-51e9c688-c996-43fd-930e-c9588e973ece tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:03.412757 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-51e9c688-c996-43fd-930e-c9588e973ece tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.150978 Aug 24 09:02:03.413410 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 394/789] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:03 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:04.264796 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0ba0109e-555e-428a-8ffa-fbff5da5e95c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:04.265439 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0ba0109e-555e-428a-8ffa-fbff5da5e95c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:04.271721 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ba0109e-555e-428a-8ffa-fbff5da5e95c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:04.272259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ba0109e-555e-428a-8ffa-fbff5da5e95c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:04.272704 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ba0109e-555e-428a-8ffa-fbff5da5e95c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:04.273401 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ba0109e-555e-428a-8ffa-fbff5da5e95c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:04.273863 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ba0109e-555e-428a-8ffa-fbff5da5e95c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:04.274293 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ba0109e-555e-428a-8ffa-fbff5da5e95c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:04.405401 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0ba0109e-555e-428a-8ffa-fbff5da5e95c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:04.413446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0ba0109e-555e-428a-8ffa-fbff5da5e95c tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1733 microversion: 2.1 time: 0.152603 Aug 24 09:02:04.414006 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 396/790] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:04 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:04.434267 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-27cede3b-2a02-4ae6-9347-f18404b86eb2 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:04.434885 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-27cede3b-2a02-4ae6-9347-f18404b86eb2 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:04.441497 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27cede3b-2a02-4ae6-9347-f18404b86eb2 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:04.441983 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27cede3b-2a02-4ae6-9347-f18404b86eb2 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:04.442424 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27cede3b-2a02-4ae6-9347-f18404b86eb2 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:04.443111 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27cede3b-2a02-4ae6-9347-f18404b86eb2 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:04.443565 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27cede3b-2a02-4ae6-9347-f18404b86eb2 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:04.443991 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-27cede3b-2a02-4ae6-9347-f18404b86eb2 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:04.580658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-27cede3b-2a02-4ae6-9347-f18404b86eb2 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:04.588908 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-27cede3b-2a02-4ae6-9347-f18404b86eb2 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1679 microversion: 2.1 time: 0.158948 Aug 24 09:02:04.589469 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 395/791] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:04 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:05.435295 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2d9cfe23-1e42-462c-9e31-5b94e64aa489 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:05.435987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2d9cfe23-1e42-462c-9e31-5b94e64aa489 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:05.441892 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d9cfe23-1e42-462c-9e31-5b94e64aa489 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.442372 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d9cfe23-1e42-462c-9e31-5b94e64aa489 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.442806 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d9cfe23-1e42-462c-9e31-5b94e64aa489 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:05.443493 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d9cfe23-1e42-462c-9e31-5b94e64aa489 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.443944 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d9cfe23-1e42-462c-9e31-5b94e64aa489 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.444395 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2d9cfe23-1e42-462c-9e31-5b94e64aa489 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:05.574784 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2d9cfe23-1e42-462c-9e31-5b94e64aa489 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:05.582922 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2d9cfe23-1e42-462c-9e31-5b94e64aa489 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1713 microversion: 2.1 time: 0.151985 Aug 24 09:02:05.583520 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 397/792] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:05 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1713 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:05.610148 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-aea30b12-10cf-4e99-8e67-85e5dec26d0c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:05.610769 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-aea30b12-10cf-4e99-8e67-85e5dec26d0c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:05.617347 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aea30b12-10cf-4e99-8e67-85e5dec26d0c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.617830 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aea30b12-10cf-4e99-8e67-85e5dec26d0c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.618260 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aea30b12-10cf-4e99-8e67-85e5dec26d0c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:05.618954 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aea30b12-10cf-4e99-8e67-85e5dec26d0c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.619925 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aea30b12-10cf-4e99-8e67-85e5dec26d0c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.620453 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aea30b12-10cf-4e99-8e67-85e5dec26d0c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:05.645402 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b96ddfe3-a14b-4191-8b2a-775da3d06cd0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:05.645901 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b96ddfe3-a14b-4191-8b2a-775da3d06cd0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:05.651859 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b96ddfe3-a14b-4191-8b2a-775da3d06cd0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.652385 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b96ddfe3-a14b-4191-8b2a-775da3d06cd0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.652824 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b96ddfe3-a14b-4191-8b2a-775da3d06cd0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:05.653557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b96ddfe3-a14b-4191-8b2a-775da3d06cd0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.654015 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b96ddfe3-a14b-4191-8b2a-775da3d06cd0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.654465 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b96ddfe3-a14b-4191-8b2a-775da3d06cd0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:05.670253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:05.745462 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-b96ddfe3-a14b-4191-8b2a-775da3d06cd0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] HTTP exception thrown: Cannot 'detach_volume' instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 while it is in vm_state rescued Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b96ddfe3-a14b-4191-8b2a-775da3d06cd0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Request method failure captured: Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-volume_attachments/e3e0a802-0323-4fb2-874e-f8597b29e42c HTTP/1.1 Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeeQeb4NIRtpVDGaM1J2L0qDK5-xS8gcYMDBqdKvfZAFL7ABp5_RCKRstcrKGyfoShIdeqdE9FKD_wQVDFs9jrdbmlMmvZ597IzHE58w9lVMS0yxPRKMLsSi3X7uPLg36ZykjHg2NXN8EaoZqvJzoNTzXyNha6h0XTNQDcUxBGp-fxM Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: b5cb111df3ec4249a836518a598063a4 Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-363289357 Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:02:05.747079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:02:05.748745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b5cb111df3ec4249a836518a598063a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b5cb111df3ec4249a836518a598063a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b5cb111df3ec4249a836518a598063a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b5cb111df3ec4249a836518a598063a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:02:05.748745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-363289357 Aug 24 09:02:05.748745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: b5cb111df3ec4249a836518a598063a4 Aug 24 09:02:05.748745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-363289357 Aug 24 09:02:05.748745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-ServerRescueNegativeTestJSON-363289357-project Aug 24 09:02:05.748745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:02:05.748745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:02:05.748745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: 8ee5364270094596b64b08a8ac56f6ce Aug 24 09:02:05.748745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-363289357-project Aug 24 09:02:05.748745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:02:05.748745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Cannot 'detach_volume' instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 while it is in vm_state rescued Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'server_id': 'e46c8263-fe1c-4e13-92a9-038085ee9ed8', 'id': 'e3e0a802-0323-4fb2-874e-f8597b29e42c'} Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:02:05.749631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:02:05.750870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 09:02:05.750870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 09:02:05.750870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 09:02:05.750870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 09:02:05.750870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 while it is in vm_state rescued Aug 24 09:02:05.750870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:05.750870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:02:05.750870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:05.750870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:05.750870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:02:05.750870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:02:05.750870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:02:05.750870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:02:05.750870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 while it is in vm_state rescued Aug 24 09:02:05.750870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:05.750870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b96ddfe3-a14b-4191-8b2a-775da3d06cd0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Returning 409 to user: Cannot 'detach_volume' instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 while it is in vm_state rescued {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:02:05.751863 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b96ddfe3-a14b-4191-8b2a-775da3d06cd0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-volume_attachments/e3e0a802-0323-4fb2-874e-f8597b29e42c" status: 409 len: 152 microversion: 2.1 time: 0.107320 Aug 24 09:02:05.751863 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 398/793] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 24 09:02:05 2022] DELETE /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-volume_attachments/e3e0a802-0323-4fb2-874e-f8597b29e42c => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 09:02:05.757263 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-712cf563-5e46-4367-89b0-028fab97bbe8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:05.757798 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-712cf563-5e46-4367-89b0-028fab97bbe8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:05.764641 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-712cf563-5e46-4367-89b0-028fab97bbe8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.764931 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-aea30b12-10cf-4e99-8e67-85e5dec26d0c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:05.765136 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-712cf563-5e46-4367-89b0-028fab97bbe8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.765582 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-712cf563-5e46-4367-89b0-028fab97bbe8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:05.766283 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-712cf563-5e46-4367-89b0-028fab97bbe8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.766743 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-712cf563-5e46-4367-89b0-028fab97bbe8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.767438 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-712cf563-5e46-4367-89b0-028fab97bbe8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:05.773484 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-aea30b12-10cf-4e99-8e67-85e5dec26d0c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1656 microversion: 2.1 time: 0.167217 Aug 24 09:02:05.774054 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 396/794] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:05 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1656 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:05.793960 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cbbe204c-2f56-48ca-a6b9-59b8ee5f7f7e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:05.799786 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbbe204c-2f56-48ca-a6b9-59b8ee5f7f7e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.800303 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbbe204c-2f56-48ca-a6b9-59b8ee5f7f7e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.800733 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cbbe204c-2f56-48ca-a6b9-59b8ee5f7f7e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:05.823995 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cbbe204c-2f56-48ca-a6b9-59b8ee5f7f7e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Going to try to start instance {{(pid=120543) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 09:02:05.833761 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-712cf563-5e46-4367-89b0-028fab97bbe8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "POST /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/action" status: 202 len: 0 microversion: 2.1 time: 0.080119 Aug 24 09:02:05.834409 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 399/795] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 24 09:02:05 2022] POST /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 09:02:05.843023 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-422e89cd-6c3d-4740-9dd4-07016c410c7f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:05.843742 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-422e89cd-6c3d-4740-9dd4-07016c410c7f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:05.850153 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-422e89cd-6c3d-4740-9dd4-07016c410c7f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.850684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-422e89cd-6c3d-4740-9dd4-07016c410c7f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.851094 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-422e89cd-6c3d-4740-9dd4-07016c410c7f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:05.851885 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-422e89cd-6c3d-4740-9dd4-07016c410c7f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.852466 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-422e89cd-6c3d-4740-9dd4-07016c410c7f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.852937 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-422e89cd-6c3d-4740-9dd4-07016c410c7f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:05.868978 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cbbe204c-2f56-48ca-a6b9-59b8ee5f7f7e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "POST /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/action" status: 202 len: 0 microversion: 2.1 time: 0.079119 Aug 24 09:02:05.873542 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 397/796] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 24 09:02:05 2022] POST /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 09:02:05.878776 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b5675d09-6a53-4e0a-b3f7-162dc4f3f1f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:05.879472 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b5675d09-6a53-4e0a-b3f7-162dc4f3f1f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:05.886696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5675d09-6a53-4e0a-b3f7-162dc4f3f1f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.887188 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5675d09-6a53-4e0a-b3f7-162dc4f3f1f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.887621 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5675d09-6a53-4e0a-b3f7-162dc4f3f1f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:05.888348 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5675d09-6a53-4e0a-b3f7-162dc4f3f1f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:05.888801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5675d09-6a53-4e0a-b3f7-162dc4f3f1f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:05.889410 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5675d09-6a53-4e0a-b3f7-162dc4f3f1f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:06.271576 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b5675d09-6a53-4e0a-b3f7-162dc4f3f1f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:06.276151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-422e89cd-6c3d-4740-9dd4-07016c410c7f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:06.280665 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b5675d09-6a53-4e0a-b3f7-162dc4f3f1f7 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1665 microversion: 2.1 time: 0.405801 Aug 24 09:02:06.281241 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 398/797] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:05 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1665 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:06.299773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-422e89cd-6c3d-4740-9dd4-07016c410c7f tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1721 microversion: 2.1 time: 0.460834 Aug 24 09:02:06.300398 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 400/798] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:05 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1721 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:07.301295 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-04e6f712-91d8-4ff8-8e9d-4ace8d18c3eb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:07.301894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-04e6f712-91d8-4ff8-8e9d-4ace8d18c3eb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:07.308423 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04e6f712-91d8-4ff8-8e9d-4ace8d18c3eb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:07.308908 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04e6f712-91d8-4ff8-8e9d-4ace8d18c3eb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:07.309343 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04e6f712-91d8-4ff8-8e9d-4ace8d18c3eb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:07.310033 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04e6f712-91d8-4ff8-8e9d-4ace8d18c3eb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:07.310492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04e6f712-91d8-4ff8-8e9d-4ace8d18c3eb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:07.310912 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-04e6f712-91d8-4ff8-8e9d-4ace8d18c3eb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:07.321246 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a4b01cf2-cb0b-47c0-971a-64c0778faf47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:07.321951 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a4b01cf2-cb0b-47c0-971a-64c0778faf47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:07.328647 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4b01cf2-cb0b-47c0-971a-64c0778faf47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:07.329145 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4b01cf2-cb0b-47c0-971a-64c0778faf47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:07.329595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4b01cf2-cb0b-47c0-971a-64c0778faf47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:07.330299 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4b01cf2-cb0b-47c0-971a-64c0778faf47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:07.330764 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4b01cf2-cb0b-47c0-971a-64c0778faf47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:07.331195 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4b01cf2-cb0b-47c0-971a-64c0778faf47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:07.511957 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-04e6f712-91d8-4ff8-8e9d-4ace8d18c3eb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:07.519471 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a4b01cf2-cb0b-47c0-971a-64c0778faf47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:07.520171 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-04e6f712-91d8-4ff8-8e9d-4ace8d18c3eb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1665 microversion: 2.1 time: 0.222656 Aug 24 09:02:07.520741 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 399/799] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:07 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1665 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:07.530959 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a4b01cf2-cb0b-47c0-971a-64c0778faf47 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1721 microversion: 2.1 time: 0.213507 Aug 24 09:02:07.531523 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 401/800] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:07 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:08.541771 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-48df3d89-7159-4256-a606-3e3128a116f1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:08.542370 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-48df3d89-7159-4256-a606-3e3128a116f1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:08.549207 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48df3d89-7159-4256-a606-3e3128a116f1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:08.549697 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48df3d89-7159-4256-a606-3e3128a116f1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:08.550135 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48df3d89-7159-4256-a606-3e3128a116f1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:08.550833 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48df3d89-7159-4256-a606-3e3128a116f1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:08.551288 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48df3d89-7159-4256-a606-3e3128a116f1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:08.551718 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-48df3d89-7159-4256-a606-3e3128a116f1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:08.552865 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a18dd170-92ba-45ce-ac36-2a43021667ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:08.553553 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a18dd170-92ba-45ce-ac36-2a43021667ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:08.560643 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a18dd170-92ba-45ce-ac36-2a43021667ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:08.561509 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a18dd170-92ba-45ce-ac36-2a43021667ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:08.561963 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a18dd170-92ba-45ce-ac36-2a43021667ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:08.562801 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a18dd170-92ba-45ce-ac36-2a43021667ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:08.563277 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a18dd170-92ba-45ce-ac36-2a43021667ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:08.563930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a18dd170-92ba-45ce-ac36-2a43021667ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:08.756570 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-48df3d89-7159-4256-a606-3e3128a116f1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:08.763657 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a18dd170-92ba-45ce-ac36-2a43021667ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:08.768306 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-48df3d89-7159-4256-a606-3e3128a116f1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1665 microversion: 2.1 time: 0.230450 Aug 24 09:02:08.768907 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 400/801] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:08 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1665 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:08.772406 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a18dd170-92ba-45ce-ac36-2a43021667ff tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1721 microversion: 2.1 time: 0.223309 Aug 24 09:02:08.772965 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 402/802] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:08 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:09.789625 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a59693ad-65f0-4cce-b784-8042cba6f0f4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:09.790251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a59693ad-65f0-4cce-b784-8042cba6f0f4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:09.793847 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8305e35e-7d44-478f-84d6-b7a4ca157e78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:09.794463 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8305e35e-7d44-478f-84d6-b7a4ca157e78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:09.797407 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a59693ad-65f0-4cce-b784-8042cba6f0f4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:09.797896 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a59693ad-65f0-4cce-b784-8042cba6f0f4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:09.798327 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a59693ad-65f0-4cce-b784-8042cba6f0f4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:09.799015 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a59693ad-65f0-4cce-b784-8042cba6f0f4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:09.799465 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a59693ad-65f0-4cce-b784-8042cba6f0f4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:09.799882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a59693ad-65f0-4cce-b784-8042cba6f0f4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:09.800649 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8305e35e-7d44-478f-84d6-b7a4ca157e78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:09.801137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8305e35e-7d44-478f-84d6-b7a4ca157e78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:09.801579 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8305e35e-7d44-478f-84d6-b7a4ca157e78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:09.802293 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8305e35e-7d44-478f-84d6-b7a4ca157e78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:09.802754 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8305e35e-7d44-478f-84d6-b7a4ca157e78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:09.803177 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8305e35e-7d44-478f-84d6-b7a4ca157e78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:09.997944 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a59693ad-65f0-4cce-b784-8042cba6f0f4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:10.002162 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8305e35e-7d44-478f-84d6-b7a4ca157e78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:10.005765 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a59693ad-65f0-4cce-b784-8042cba6f0f4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1669 microversion: 2.1 time: 0.219973 Aug 24 09:02:10.006340 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 401/803] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:09 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1669 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:10.010639 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8305e35e-7d44-478f-84d6-b7a4ca157e78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1721 microversion: 2.1 time: 0.221214 Aug 24 09:02:10.011156 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 403/804] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:09 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:11.032028 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dca144be-29cd-407a-a311-08ac850416e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:11.032630 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dca144be-29cd-407a-a311-08ac850416e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:11.038983 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dca144be-29cd-407a-a311-08ac850416e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:11.039472 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dca144be-29cd-407a-a311-08ac850416e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:11.039912 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dca144be-29cd-407a-a311-08ac850416e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:11.040634 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dca144be-29cd-407a-a311-08ac850416e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:11.041093 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dca144be-29cd-407a-a311-08ac850416e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:11.042092 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dca144be-29cd-407a-a311-08ac850416e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:11.174885 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-dca144be-29cd-407a-a311-08ac850416e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:11.184059 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dca144be-29cd-407a-a311-08ac850416e7 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1727 microversion: 2.1 time: 0.155981 Aug 24 09:02:11.184648 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 402/805] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:11 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:11.204399 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7833dcc9-cae4-4d51-be09-43d83781b67d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:11.204946 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7833dcc9-cae4-4d51-be09-43d83781b67d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:11.211057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7833dcc9-cae4-4d51-be09-43d83781b67d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:11.211539 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7833dcc9-cae4-4d51-be09-43d83781b67d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:11.211977 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7833dcc9-cae4-4d51-be09-43d83781b67d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:11.212721 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7833dcc9-cae4-4d51-be09-43d83781b67d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:11.213213 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7833dcc9-cae4-4d51-be09-43d83781b67d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:11.213644 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7833dcc9-cae4-4d51-be09-43d83781b67d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:11.290902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7833dcc9-cae4-4d51-be09-43d83781b67d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090447 Aug 24 09:02:11.292450 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 404/806] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 24 09:02:11 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:02:12.416866 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-3d1c0d20-d296-4786-8a95-5d6849af3270 req-3aaf6c66-f739-4cfb-ab2a-110fe5cfee69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e46c8263-fe1c-4e13-92a9-038085ee9ed8", "tag": "1bd5c04d-326a-446b-b57a-525d40d706b9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:12.427161 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3d1c0d20-d296-4786-8a95-5d6849af3270 req-3aaf6c66-f739-4cfb-ab2a-110fe5cfee69 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:12.427736 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3d1c0d20-d296-4786-8a95-5d6849af3270 req-3aaf6c66-f739-4cfb-ab2a-110fe5cfee69 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:12.428270 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3d1c0d20-d296-4786-8a95-5d6849af3270 req-3aaf6c66-f739-4cfb-ab2a-110fe5cfee69 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:12.433610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:12.442249 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-3d1c0d20-d296-4786-8a95-5d6849af3270 req-3aaf6c66-f739-4cfb-ab2a-110fe5cfee69 service nova] Creating event network-changed:1bd5c04d-326a-446b-b57a-525d40d706b9 for instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 on hv-cinder-83538 Aug 24 09:02:12.448020 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-3d1c0d20-d296-4786-8a95-5d6849af3270 req-3aaf6c66-f739-4cfb-ab2a-110fe5cfee69 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035165 Aug 24 09:02:12.448666 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 403/807] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:02:14.461935 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2c2d4fee-4625-4c0f-8941-16c0c3046722 req-6a12f772-a05a-4c4e-9116-84c44fe86141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e46c8263-fe1c-4e13-92a9-038085ee9ed8", "tag": "1bd5c04d-326a-446b-b57a-525d40d706b9"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:14.471732 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2c2d4fee-4625-4c0f-8941-16c0c3046722 req-6a12f772-a05a-4c4e-9116-84c44fe86141 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:14.472238 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2c2d4fee-4625-4c0f-8941-16c0c3046722 req-6a12f772-a05a-4c4e-9116-84c44fe86141 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:14.472660 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2c2d4fee-4625-4c0f-8941-16c0c3046722 req-6a12f772-a05a-4c4e-9116-84c44fe86141 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:14.484212 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2c2d4fee-4625-4c0f-8941-16c0c3046722 req-6a12f772-a05a-4c4e-9116-84c44fe86141 service nova] Creating event network-changed:1bd5c04d-326a-446b-b57a-525d40d706b9 for instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 on hv-cinder-83538 Aug 24 09:02:14.489188 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2c2d4fee-4625-4c0f-8941-16c0c3046722 req-6a12f772-a05a-4c4e-9116-84c44fe86141 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030955 Aug 24 09:02:14.489796 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 405/808] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:02:29.548633 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4002a122-20c0-4603-8326-01daecb63ca5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:29.549220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4002a122-20c0-4603-8326-01daecb63ca5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:29.551545 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=55 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:29.558880 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4002a122-20c0-4603-8326-01daecb63ca5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:29.559906 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4002a122-20c0-4603-8326-01daecb63ca5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:29.560527 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4002a122-20c0-4603-8326-01daecb63ca5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:29.561251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4002a122-20c0-4603-8326-01daecb63ca5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:29.561712 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4002a122-20c0-4603-8326-01daecb63ca5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:29.562145 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4002a122-20c0-4603-8326-01daecb63ca5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:29.591510 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4002a122-20c0-4603-8326-01daecb63ca5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5/ips" status: 200 len: 148 microversion: 2.1 time: 0.048248 Aug 24 09:02:29.592119 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 404/809] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 24 09:02:29 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5/ips => generated 148 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:02:29.600886 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=31 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:29.601655 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:29.608088 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-29195f8c-29fb-4b9e-947a-321729566d5a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e6ae117-b462-4b3a-bdc9-b46ad034d10b"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:29.610535 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-29195f8c-29fb-4b9e-947a-321729566d5a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:29.617993 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29195f8c-29fb-4b9e-947a-321729566d5a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:29.618472 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29195f8c-29fb-4b9e-947a-321729566d5a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:29.618913 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29195f8c-29fb-4b9e-947a-321729566d5a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:29.619599 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29195f8c-29fb-4b9e-947a-321729566d5a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:29.620049 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29195f8c-29fb-4b9e-947a-321729566d5a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:29.620497 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-29195f8c-29fb-4b9e-947a-321729566d5a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:29.721621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-29195f8c-29fb-4b9e-947a-321729566d5a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] HTTP exception thrown: Invalid volume: volume 7e6ae117-b462-4b3a-bdc9-b46ad034d10b is already attached to instances: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-29195f8c-29fb-4b9e-947a-321729566d5a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Request method failure captured: Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: POST /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5/os-volume_attachments HTTP/1.1 Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 74 Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeebN0Zobm2z9rP6Ekh4dDHbb3SuIkLHnpc3jkEcaHX4GwAfCoUa-aKWg_1MrmPsv97hdPp9j0fQ8hJI9Rp88PNgp2Z4khPlc0lMhYOfsdGUEPCdmARxQAqvXejsu5r4s5TUgAt8jNrxZH2x0zVTldxkuHkKggh8MFCnTglnQHmP2Dw Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:02:29.723628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:02:29.725187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:02:29.725187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:02:29.725187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:02:29.725187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:02:29.725187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:02:29.725187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:02:29.725187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:02:29.725187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: bd0929f371e4442eb4eb6e12a96bbfc4 Aug 24 09:02:29.725187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:02:29.725187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Aug 24 09:02:29.725187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {"volumeAttachment": {"volumeId": "7e6ae117-b462-4b3a-bdc9-b46ad034d10b"}} Aug 24 09:02:29.725187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Invalid volume: volume 7e6ae117-b462-4b3a-bdc9-b46ad034d10b is already attached to instances: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'server_id': '08718641-a85b-4edf-9dc2-c8e30724b3b5', 'body': {'volumeAttachment': {'volumeId': '7e6ae117-b462-4b3a-bdc9-b46ad034d10b'}}} Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7e6ae117-b462-4b3a-bdc9-b46ad034d10b is already attached to instances: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:29.726143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7e6ae117-b462-4b3a-bdc9-b46ad034d10b is already attached to instances: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:29.727929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:02:29.730092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:02:29.730092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:02:29.730092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:02:29.730092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7e6ae117-b462-4b3a-bdc9-b46ad034d10b is already attached to instances: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 Aug 24 09:02:29.730092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:29.730092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-29195f8c-29fb-4b9e-947a-321729566d5a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Returning 400 to user: Invalid volume: volume 7e6ae117-b462-4b3a-bdc9-b46ad034d10b is already attached to instances: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:02:29.730092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-29195f8c-29fb-4b9e-947a-321729566d5a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "POST /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.125449 Aug 24 09:02:29.730092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 406/810] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 24 09:02:29 2022] POST /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5/os-volume_attachments => generated 174 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:02:29.736817 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0062dfc3-70e1-4fe4-9981-26ac5566788c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:29.737518 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0062dfc3-70e1-4fe4-9981-26ac5566788c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:29.745017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0062dfc3-70e1-4fe4-9981-26ac5566788c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:29.745597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0062dfc3-70e1-4fe4-9981-26ac5566788c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:29.746041 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0062dfc3-70e1-4fe4-9981-26ac5566788c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:29.746751 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0062dfc3-70e1-4fe4-9981-26ac5566788c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:29.748071 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0062dfc3-70e1-4fe4-9981-26ac5566788c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:29.748673 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0062dfc3-70e1-4fe4-9981-26ac5566788c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:29.773918 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0062dfc3-70e1-4fe4-9981-26ac5566788c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:02:29.849431 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0062dfc3-70e1-4fe4-9981-26ac5566788c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "DELETE /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 204 len: 0 microversion: 2.1 time: 0.117766 Aug 24 09:02:29.850389 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 405/811] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:02:29 2022] DELETE /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:02:29.860605 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ace961a2-bbf3-43a1-a6ad-5aa5fbcfb6f8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:29.861538 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ace961a2-bbf3-43a1-a6ad-5aa5fbcfb6f8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:29.868406 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ace961a2-bbf3-43a1-a6ad-5aa5fbcfb6f8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:29.868897 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ace961a2-bbf3-43a1-a6ad-5aa5fbcfb6f8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:29.869338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ace961a2-bbf3-43a1-a6ad-5aa5fbcfb6f8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:29.870041 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ace961a2-bbf3-43a1-a6ad-5aa5fbcfb6f8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:29.870506 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ace961a2-bbf3-43a1-a6ad-5aa5fbcfb6f8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:29.870936 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ace961a2-bbf3-43a1-a6ad-5aa5fbcfb6f8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:30.025778 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ace961a2-bbf3-43a1-a6ad-5aa5fbcfb6f8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:30.034710 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ace961a2-bbf3-43a1-a6ad-5aa5fbcfb6f8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1679 microversion: 2.1 time: 0.179877 Aug 24 09:02:30.035279 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 407/812] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:29 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:31.058549 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5750216d-a35c-4e35-8e25-b8b7531b946a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:31.059169 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5750216d-a35c-4e35-8e25-b8b7531b946a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:31.065838 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5750216d-a35c-4e35-8e25-b8b7531b946a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:31.066330 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5750216d-a35c-4e35-8e25-b8b7531b946a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:31.066771 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5750216d-a35c-4e35-8e25-b8b7531b946a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:31.067474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5750216d-a35c-4e35-8e25-b8b7531b946a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:31.067942 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5750216d-a35c-4e35-8e25-b8b7531b946a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:31.068390 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5750216d-a35c-4e35-8e25-b8b7531b946a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:31.231639 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5750216d-a35c-4e35-8e25-b8b7531b946a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:31.241980 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5750216d-a35c-4e35-8e25-b8b7531b946a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1679 microversion: 2.1 time: 0.188067 Aug 24 09:02:31.242808 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 406/813] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:31 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:32.268937 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2c5ecd59-34ed-42ac-bdc8-07d577c5f693 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:32.270213 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2c5ecd59-34ed-42ac-bdc8-07d577c5f693 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:32.276971 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c5ecd59-34ed-42ac-bdc8-07d577c5f693 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:32.277461 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c5ecd59-34ed-42ac-bdc8-07d577c5f693 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:32.277899 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c5ecd59-34ed-42ac-bdc8-07d577c5f693 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:32.279261 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c5ecd59-34ed-42ac-bdc8-07d577c5f693 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:32.279720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c5ecd59-34ed-42ac-bdc8-07d577c5f693 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:32.280171 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2c5ecd59-34ed-42ac-bdc8-07d577c5f693 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:32.532082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2c5ecd59-34ed-42ac-bdc8-07d577c5f693 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:32.540471 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2c5ecd59-34ed-42ac-bdc8-07d577c5f693 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1679 microversion: 2.1 time: 0.275297 Aug 24 09:02:32.541056 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 408/814] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:32 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1679 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:33.017482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-e069c49e-c024-4bf6-b314-3245042ea581 req-a3190a2b-53c6-4150-baf1-c2525804769b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08718641-a85b-4edf-9dc2-c8e30724b3b5", "name": "network-vif-deleted", "tag": "8c8399ef-892b-41d4-b7ba-affd23dd9979"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:33.032310 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e069c49e-c024-4bf6-b314-3245042ea581 req-a3190a2b-53c6-4150-baf1-c2525804769b service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:33.033112 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e069c49e-c024-4bf6-b314-3245042ea581 req-a3190a2b-53c6-4150-baf1-c2525804769b service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:33.033838 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-e069c49e-c024-4bf6-b314-3245042ea581 req-a3190a2b-53c6-4150-baf1-c2525804769b service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:33.055777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-e069c49e-c024-4bf6-b314-3245042ea581 req-a3190a2b-53c6-4150-baf1-c2525804769b service nova] Creating event network-vif-deleted:8c8399ef-892b-41d4-b7ba-affd23dd9979 for instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 on hv-cinder-83538 Aug 24 09:02:33.064435 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-e069c49e-c024-4bf6-b314-3245042ea581 req-a3190a2b-53c6-4150-baf1-c2525804769b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057220 Aug 24 09:02:33.065580 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 407/815] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:02:33.563806 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b1752d80-3627-40c5-9daa-4eea1686ac69 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:33.564445 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b1752d80-3627-40c5-9daa-4eea1686ac69 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:33.572928 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1752d80-3627-40c5-9daa-4eea1686ac69 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:33.573429 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1752d80-3627-40c5-9daa-4eea1686ac69 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:33.573896 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1752d80-3627-40c5-9daa-4eea1686ac69 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:33.574778 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1752d80-3627-40c5-9daa-4eea1686ac69 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:33.575456 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1752d80-3627-40c5-9daa-4eea1686ac69 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:33.576352 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1752d80-3627-40c5-9daa-4eea1686ac69 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:33.611691 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1752d80-3627-40c5-9daa-4eea1686ac69 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:33.612514 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1752d80-3627-40c5-9daa-4eea1686ac69 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:33.613201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b1752d80-3627-40c5-9daa-4eea1686ac69 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:33.613731 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-b1752d80-3627-40c5-9daa-4eea1686ac69 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lazy-loading 'fault' on Instance uuid 08718641-a85b-4edf-9dc2-c8e30724b3b5 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:02:33.666077 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b1752d80-3627-40c5-9daa-4eea1686ac69 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:33.674703 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b1752d80-3627-40c5-9daa-4eea1686ac69 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 200 len: 1330 microversion: 2.1 time: 0.115454 Aug 24 09:02:33.675294 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 409/816] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:33 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 1330 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:34.698067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9dd59873-d505-48d2-8e78-153247ad9723 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:34.698774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9dd59873-d505-48d2-8e78-153247ad9723 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:34.705845 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9dd59873-d505-48d2-8e78-153247ad9723 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:34.706333 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9dd59873-d505-48d2-8e78-153247ad9723 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:34.706792 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9dd59873-d505-48d2-8e78-153247ad9723 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:34.707666 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9dd59873-d505-48d2-8e78-153247ad9723 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:34.707938 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9dd59873-d505-48d2-8e78-153247ad9723 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:34.708415 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9dd59873-d505-48d2-8e78-153247ad9723 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:34.722511 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-9dd59873-d505-48d2-8e78-153247ad9723 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] HTTP exception thrown: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9dd59873-d505-48d2-8e78-153247ad9723 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Request method failure captured: Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 HTTP/1.1 Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeebN0Zobm2z9rP6Ekh4dDHbb3SuIkLHnpc3jkEcaHX4GwAfCoUa-aKWg_1MrmPsv97hdPp9j0fQ8hJI9Rp88PNgp2Z4khPlc0lMhYOfsdGUEPCdmARxQAqvXejsu5r4s5TUgAt8jNrxZH2x0zVTldxkuHkKggh8MFCnTglnQHmP2Dw Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:02:34.724294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:02:34.725904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:02:34.725904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:02:34.725904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:02:34.725904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:02:34.725904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:02:34.725904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:02:34.725904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:02:34.725904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: bd0929f371e4442eb4eb6e12a96bbfc4 Aug 24 09:02:34.725904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:02:34.725904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:02:34.725904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. Aug 24 09:02:34.725904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': '08718641-a85b-4edf-9dc2-c8e30724b3b5'} Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:02:34.726737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. Aug 24 09:02:34.728342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:02:34.730084 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9dd59873-d505-48d2-8e78-153247ad9723 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Returning 404 to user: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:02:34.730084 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9dd59873-d505-48d2-8e78-153247ad9723 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 404 len: 111 microversion: 2.1 time: 0.032529 Aug 24 09:02:34.730084 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 408/817] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:34 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:02:34.735187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7848f698-2dc9-4075-8e86-ce82bd53bd02 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '.version_select at 0x7fb140f73ca0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:34.756126 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7848f698-2dc9-4075-8e86-ce82bd53bd02 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-640831116" status: 202 len: 0 microversion: 2.1 time: 0.024907 Aug 24 09:02:34.756888 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 410/818] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 24 09:02:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-640831116 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:02:35.478246 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-aad2cdfb-adc1-47ed-ab53-bbb5f1988f15 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:35.478737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-aad2cdfb-adc1-47ed-ab53-bbb5f1988f15 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:35.484807 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aad2cdfb-adc1-47ed-ab53-bbb5f1988f15 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:35.485240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aad2cdfb-adc1-47ed-ab53-bbb5f1988f15 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:35.485675 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aad2cdfb-adc1-47ed-ab53-bbb5f1988f15 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:35.486370 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aad2cdfb-adc1-47ed-ab53-bbb5f1988f15 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:35.486827 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aad2cdfb-adc1-47ed-ab53-bbb5f1988f15 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:35.487253 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aad2cdfb-adc1-47ed-ab53-bbb5f1988f15 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:35.630166 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-aad2cdfb-adc1-47ed-ab53-bbb5f1988f15 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lazy-loading 'services' on Instance uuid 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:02:35.746014 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-aad2cdfb-adc1-47ed-ab53-bbb5f1988f15 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645/os-volume_attachments/7e6ae117-b462-4b3a-bdc9-b46ad034d10b" status: 202 len: 0 microversion: 2.1 time: 0.271500 Aug 24 09:02:35.746635 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 409/819] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 24 09:02:35 2022] DELETE /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645/os-volume_attachments/7e6ae117-b462-4b3a-bdc9-b46ad034d10b => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:02:35.757559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ebb7594f-3008-4278-93f0-5f48e2404519 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:35.759764 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ebb7594f-3008-4278-93f0-5f48e2404519 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:35.769150 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebb7594f-3008-4278-93f0-5f48e2404519 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:35.769891 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebb7594f-3008-4278-93f0-5f48e2404519 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:35.770328 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebb7594f-3008-4278-93f0-5f48e2404519 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:35.771035 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebb7594f-3008-4278-93f0-5f48e2404519 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:35.771489 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebb7594f-3008-4278-93f0-5f48e2404519 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:35.771915 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ebb7594f-3008-4278-93f0-5f48e2404519 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:35.802851 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ebb7594f-3008-4278-93f0-5f48e2404519 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050485 Aug 24 09:02:35.803398 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 411/820] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:02:35 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:02:36.818115 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-38b93122-ec9d-4913-accd-d880b70d78c2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:36.820510 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-38b93122-ec9d-4913-accd-d880b70d78c2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:36.827665 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38b93122-ec9d-4913-accd-d880b70d78c2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:36.828162 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38b93122-ec9d-4913-accd-d880b70d78c2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:36.828594 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38b93122-ec9d-4913-accd-d880b70d78c2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:36.829280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38b93122-ec9d-4913-accd-d880b70d78c2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:36.829735 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38b93122-ec9d-4913-accd-d880b70d78c2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:36.830152 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-38b93122-ec9d-4913-accd-d880b70d78c2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:36.862105 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-38b93122-ec9d-4913-accd-d880b70d78c2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048393 Aug 24 09:02:36.868763 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 410/821] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:02:36 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:02:37.876967 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9768934-bfdb-4d73-91c2-926a0d18e6b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:37.879179 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9768934-bfdb-4d73-91c2-926a0d18e6b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:37.885546 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9768934-bfdb-4d73-91c2-926a0d18e6b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:37.886031 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9768934-bfdb-4d73-91c2-926a0d18e6b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:37.886471 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9768934-bfdb-4d73-91c2-926a0d18e6b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:37.887187 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9768934-bfdb-4d73-91c2-926a0d18e6b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:37.887645 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9768934-bfdb-4d73-91c2-926a0d18e6b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:37.888193 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9768934-bfdb-4d73-91c2-926a0d18e6b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:37.919936 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9768934-bfdb-4d73-91c2-926a0d18e6b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046963 Aug 24 09:02:37.920588 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 412/822] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:02:37 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:02:37.984118 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-59297297-197d-4704-b8ea-a95fb77d58f3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:37.984655 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-59297297-197d-4704-b8ea-a95fb77d58f3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:37.990749 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59297297-197d-4704-b8ea-a95fb77d58f3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:37.991217 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59297297-197d-4704-b8ea-a95fb77d58f3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:37.991653 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59297297-197d-4704-b8ea-a95fb77d58f3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:37.992448 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59297297-197d-4704-b8ea-a95fb77d58f3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:37.992850 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59297297-197d-4704-b8ea-a95fb77d58f3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:37.993271 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59297297-197d-4704-b8ea-a95fb77d58f3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:38.018991 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-59297297-197d-4704-b8ea-a95fb77d58f3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:02:38.097665 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-59297297-197d-4704-b8ea-a95fb77d58f3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 204 len: 0 microversion: 2.1 time: 0.117452 Aug 24 09:02:38.098330 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 411/823] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:02:37 2022] DELETE /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:02:38.107334 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-528aa0d7-8aac-4b99-8b4c-fdcbe21c8ae1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:38.107945 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-528aa0d7-8aac-4b99-8b4c-fdcbe21c8ae1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:38.114031 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-528aa0d7-8aac-4b99-8b4c-fdcbe21c8ae1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:38.114524 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-528aa0d7-8aac-4b99-8b4c-fdcbe21c8ae1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:38.114966 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-528aa0d7-8aac-4b99-8b4c-fdcbe21c8ae1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:38.115717 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-528aa0d7-8aac-4b99-8b4c-fdcbe21c8ae1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:38.116233 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-528aa0d7-8aac-4b99-8b4c-fdcbe21c8ae1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:38.116694 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-528aa0d7-8aac-4b99-8b4c-fdcbe21c8ae1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:38.251156 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-528aa0d7-8aac-4b99-8b4c-fdcbe21c8ae1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:38.259166 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-528aa0d7-8aac-4b99-8b4c-fdcbe21c8ae1 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1679 microversion: 2.1 time: 0.156453 Aug 24 09:02:38.260222 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 413/824] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:38 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:39.282374 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-80cae759-6ad7-4f64-8c6b-02b471330330 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:39.282374 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-80cae759-6ad7-4f64-8c6b-02b471330330 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:39.289096 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80cae759-6ad7-4f64-8c6b-02b471330330 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:39.289586 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80cae759-6ad7-4f64-8c6b-02b471330330 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:39.290058 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80cae759-6ad7-4f64-8c6b-02b471330330 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:39.290756 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80cae759-6ad7-4f64-8c6b-02b471330330 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:39.291265 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80cae759-6ad7-4f64-8c6b-02b471330330 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:39.291685 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80cae759-6ad7-4f64-8c6b-02b471330330 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:39.867336 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-80cae759-6ad7-4f64-8c6b-02b471330330 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:39.875123 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-80cae759-6ad7-4f64-8c6b-02b471330330 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1679 microversion: 2.1 time: 0.597745 Aug 24 09:02:39.876020 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 412/825] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:39 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1679 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:40.424924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-7d42fc10-662c-4381-b1bc-b26d3d5d8c38 req-a3ffaf86-2e90-4a96-9a9c-7b79749b30b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e52bd97-9ce6-4cc5-bd9a-3218b1a23645", "name": "network-vif-deleted", "tag": "3da9d3b1-4548-4832-aac1-7c9959b42dc0"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:40.435482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7d42fc10-662c-4381-b1bc-b26d3d5d8c38 req-a3ffaf86-2e90-4a96-9a9c-7b79749b30b7 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:40.442185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7d42fc10-662c-4381-b1bc-b26d3d5d8c38 req-a3ffaf86-2e90-4a96-9a9c-7b79749b30b7 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:40.442663 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7d42fc10-662c-4381-b1bc-b26d3d5d8c38 req-a3ffaf86-2e90-4a96-9a9c-7b79749b30b7 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:40.456315 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-7d42fc10-662c-4381-b1bc-b26d3d5d8c38 req-a3ffaf86-2e90-4a96-9a9c-7b79749b30b7 service nova] Creating event network-vif-deleted:3da9d3b1-4548-4832-aac1-7c9959b42dc0 for instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 on hv-cinder-83538 Aug 24 09:02:40.461368 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-7d42fc10-662c-4381-b1bc-b26d3d5d8c38 req-a3ffaf86-2e90-4a96-9a9c-7b79749b30b7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040097 Aug 24 09:02:40.462213 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 414/826] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:02:40.897062 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-935641f2-2679-4e00-93cc-e3306f29aeb8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:40.897851 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-935641f2-2679-4e00-93cc-e3306f29aeb8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:40.904718 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-935641f2-2679-4e00-93cc-e3306f29aeb8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:40.905368 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-935641f2-2679-4e00-93cc-e3306f29aeb8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:40.905910 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-935641f2-2679-4e00-93cc-e3306f29aeb8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:40.906721 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-935641f2-2679-4e00-93cc-e3306f29aeb8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:40.907282 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-935641f2-2679-4e00-93cc-e3306f29aeb8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:40.907813 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-935641f2-2679-4e00-93cc-e3306f29aeb8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:40.944646 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-935641f2-2679-4e00-93cc-e3306f29aeb8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:40.945280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-935641f2-2679-4e00-93cc-e3306f29aeb8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:40.945841 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-935641f2-2679-4e00-93cc-e3306f29aeb8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:40.946528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-935641f2-2679-4e00-93cc-e3306f29aeb8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lazy-loading 'fault' on Instance uuid 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:02:41.012698 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-935641f2-2679-4e00-93cc-e3306f29aeb8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:41.020334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-935641f2-2679-4e00-93cc-e3306f29aeb8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 200 len: 1330 microversion: 2.1 time: 0.127213 Aug 24 09:02:41.021126 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 413/827] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:40 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 1330 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:42.047310 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-426b1941-514d-4acd-8c8b-6a4b5560dd42 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:42.048019 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-426b1941-514d-4acd-8c8b-6a4b5560dd42 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:42.054173 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-426b1941-514d-4acd-8c8b-6a4b5560dd42 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:42.054659 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-426b1941-514d-4acd-8c8b-6a4b5560dd42 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:42.055100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-426b1941-514d-4acd-8c8b-6a4b5560dd42 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:42.055845 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-426b1941-514d-4acd-8c8b-6a4b5560dd42 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:42.056338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-426b1941-514d-4acd-8c8b-6a4b5560dd42 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:42.056771 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-426b1941-514d-4acd-8c8b-6a4b5560dd42 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:42.072494 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-426b1941-514d-4acd-8c8b-6a4b5560dd42 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] HTTP exception thrown: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-426b1941-514d-4acd-8c8b-6a4b5560dd42 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Request method failure captured: Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 HTTP/1.1 Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeebN0Zobm2z9rP6Ekh4dDHbb3SuIkLHnpc3jkEcaHX4GwAfCoUa-aKWg_1MrmPsv97hdPp9j0fQ8hJI9Rp88PNgp2Z4khPlc0lMhYOfsdGUEPCdmARxQAqvXejsu5r4s5TUgAt8jNrxZH2x0zVTldxkuHkKggh8MFCnTglnQHmP2Dw Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:02:42.074151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:02:42.075790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:02:42.075790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:02:42.075790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:02:42.075790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:02:42.075790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:02:42.075790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:02:42.075790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:02:42.075790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: bd0929f371e4442eb4eb6e12a96bbfc4 Aug 24 09:02:42.075790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:02:42.075790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:02:42.075790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. Aug 24 09:02:42.075790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '4e52bd97-9ce6-4cc5-bd9a-3218b1a23645'} Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:02:42.077224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. Aug 24 09:02:42.079057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:42.080563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-426b1941-514d-4acd-8c8b-6a4b5560dd42 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Returning 404 to user: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:02:42.080563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-426b1941-514d-4acd-8c8b-6a4b5560dd42 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 404 len: 111 microversion: 2.1 time: 0.032614 Aug 24 09:02:42.080563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 415/828] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:42 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:02:42.085613 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-719e4d59-055d-4324-8c2c-c35fcd61cf3d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '.version_select at 0x7fb1455c1d30>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:42.104873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-719e4d59-055d-4324-8c2c-c35fcd61cf3d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-451735605" status: 202 len: 0 microversion: 2.1 time: 0.023035 Aug 24 09:02:42.105428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 414/829] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 24 09:02:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-451735605 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:02:42.757599 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3b45b8c3-7283-4c8e-a29a-55b6ad590c4d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Action: 'create', calling method: .version_select at 0x7fb140ef8ee0>, body: {"keypair": {"name": "tempest-keypair-1962717688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPwOtu27nStO3tRqn9pRnbBlwxm0KoMthFfWIEDvHRRe0Q5ehgomHie2S/iaOtBQUHR3wW8UXDXwIaxHisG21LQ9k37YQkZhRWwPOdDzBlb1DTyu2QgqzWgJU3WJFNDbg=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:42.773044 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-3b45b8c3-7283-4c8e-a29a-55b6ad590c4d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Getting quotas for project 7e6183eeb3ff43e79eccb5d7ad08c53c. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:02:42.776869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-3b45b8c3-7283-4c8e-a29a-55b6ad590c4d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Getting quotas for user bd0929f371e4442eb4eb6e12a96bbfc4 and project 7e6183eeb3ff43e79eccb5d7ad08c53c. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:02:42.799299 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3b45b8c3-7283-4c8e-a29a-55b6ad590c4d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045507 Aug 24 09:02:42.799884 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 416/830] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 24 09:02:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:02:43.548463 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b46a822b-0f53-4f61-a0ca-3528af418f50 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:43.548993 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b46a822b-0f53-4f61-a0ca-3528af418f50 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:43.554866 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b46a822b-0f53-4f61-a0ca-3528af418f50 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:43.555348 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b46a822b-0f53-4f61-a0ca-3528af418f50 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:43.555779 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b46a822b-0f53-4f61-a0ca-3528af418f50 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:43.556568 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b46a822b-0f53-4f61-a0ca-3528af418f50 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:43.557016 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b46a822b-0f53-4f61-a0ca-3528af418f50 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:43.557438 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b46a822b-0f53-4f61-a0ca-3528af418f50 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:43.588766 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b46a822b-0f53-4f61-a0ca-3528af418f50 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/os-volume_attachments/c8e9dd4c-8bb7-44a4-8933-6264b50968aa" status: 200 len: 194 microversion: 2.20 time: 0.046430 Aug 24 09:02:43.589365 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 415/831] 10.222.0.67 () {60 vars in 1454 bytes} [Wed Aug 24 09:02:43 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/os-volume_attachments/c8e9dd4c-8bb7-44a4-8933-6264b50968aa => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:02:43.660402 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b24baddc-59f6-4d5d-8057-8775205edfb3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:43.660910 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b24baddc-59f6-4d5d-8057-8775205edfb3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:43.666339 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b24baddc-59f6-4d5d-8057-8775205edfb3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:43.666817 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b24baddc-59f6-4d5d-8057-8775205edfb3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:43.667251 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b24baddc-59f6-4d5d-8057-8775205edfb3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:43.667938 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b24baddc-59f6-4d5d-8057-8775205edfb3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:43.668414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b24baddc-59f6-4d5d-8057-8775205edfb3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:43.668831 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b24baddc-59f6-4d5d-8057-8775205edfb3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:43.756346 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-b24baddc-59f6-4d5d-8057-8775205edfb3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lazy-loading 'services' on Instance uuid 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:02:43.831527 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b24baddc-59f6-4d5d-8057-8775205edfb3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/os-volume_attachments/c8e9dd4c-8bb7-44a4-8933-6264b50968aa" status: 202 len: 0 microversion: 2.20 time: 0.174906 Aug 24 09:02:43.832290 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 417/832] 10.222.0.67 () {60 vars in 1457 bytes} [Wed Aug 24 09:02:43 2022] DELETE /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/os-volume_attachments/c8e9dd4c-8bb7-44a4-8933-6264b50968aa => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 09:02:43.841925 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3cc79a1e-3323-424d-b464-962f1fddc4db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:43.844264 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3cc79a1e-3323-424d-b464-962f1fddc4db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:43.851026 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cc79a1e-3323-424d-b464-962f1fddc4db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:43.851939 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cc79a1e-3323-424d-b464-962f1fddc4db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:43.852515 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cc79a1e-3323-424d-b464-962f1fddc4db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:43.854067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cc79a1e-3323-424d-b464-962f1fddc4db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:43.854551 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cc79a1e-3323-424d-b464-962f1fddc4db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:43.855837 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3cc79a1e-3323-424d-b464-962f1fddc4db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:43.886522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3cc79a1e-3323-424d-b464-962f1fddc4db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049668 Aug 24 09:02:43.887073 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 416/833] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 24 09:02:43 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:02:44.124886 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1835040316", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42dddf86-1ed2-4180-bf35-64505e861ee8"}], "security_groups": [{"name": "tempest-securitygroup--726664929"}], "key_name": "tempest-keypair-1962717688", "user_data": "}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:44.228333 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] validate_networks() for [('42dddf86-1ed2-4180-bf35-64505e861ee8', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:02:44.610832 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:02:44.611269 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:02:44.611746 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:02:44.612194 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:02:44.612624 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:02:44.621692 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:44.622185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:44.622652 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:44.623637 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:44.624128 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:44.624556 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:44.642100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Getting quotas for project 7e6183eeb3ff43e79eccb5d7ad08c53c. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:02:44.646331 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Getting quotas for user bd0929f371e4442eb4eb6e12a96bbfc4 and project 7e6183eeb3ff43e79eccb5d7ad08c53c. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:02:44.658060 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:02:44.660601 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:02:44.707601 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9fc8d8fe-3d2c-42e6-a92b-6802f8d25819 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.588630 Aug 24 09:02:44.708279 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 418/834] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 09:02:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:02:44.721450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-177b006f-ffa6-48ad-86fa-86c395ebb451 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:44.722748 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-177b006f-ffa6-48ad-86fa-86c395ebb451 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:44.785112 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-177b006f-ffa6-48ad-86fa-86c395ebb451 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:44.792175 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-177b006f-ffa6-48ad-86fa-86c395ebb451 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1242 microversion: 2.1 time: 0.076695 Aug 24 09:02:44.792740 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 417/835] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:44 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:44.899625 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e92b309f-43fb-4e84-b175-5337ff089315 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:44.901867 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e92b309f-43fb-4e84-b175-5337ff089315 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:44.909296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e92b309f-43fb-4e84-b175-5337ff089315 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:44.909798 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e92b309f-43fb-4e84-b175-5337ff089315 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:44.910221 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e92b309f-43fb-4e84-b175-5337ff089315 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:44.910915 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e92b309f-43fb-4e84-b175-5337ff089315 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:44.911370 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e92b309f-43fb-4e84-b175-5337ff089315 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:44.911788 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e92b309f-43fb-4e84-b175-5337ff089315 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:44.941320 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e92b309f-43fb-4e84-b175-5337ff089315 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046180 Aug 24 09:02:44.942164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 419/836] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 24 09:02:44 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:45.018349 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2ee8dac6-6fca-4196-95b1-f5f553b5c686 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:45.019277 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2ee8dac6-6fca-4196-95b1-f5f553b5c686 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:45.031053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ee8dac6-6fca-4196-95b1-f5f553b5c686 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:45.032228 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ee8dac6-6fca-4196-95b1-f5f553b5c686 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:45.032972 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ee8dac6-6fca-4196-95b1-f5f553b5c686 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:45.034103 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ee8dac6-6fca-4196-95b1-f5f553b5c686 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:45.034678 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ee8dac6-6fca-4196-95b1-f5f553b5c686 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:45.035602 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2ee8dac6-6fca-4196-95b1-f5f553b5c686 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:45.067465 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2ee8dac6-6fca-4196-95b1-f5f553b5c686 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:02:45.108624 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:45.160190 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2ee8dac6-6fca-4196-95b1-f5f553b5c686 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 204 len: 0 microversion: 2.20 time: 0.146453 Aug 24 09:02:45.161050 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 418/837] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 24 09:02:45 2022] DELETE /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 09:02:45.169555 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ff6b2b2b-74f3-4181-b71b-6fd105ffaaed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:45.170379 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ff6b2b2b-74f3-4181-b71b-6fd105ffaaed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:45.177112 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff6b2b2b-74f3-4181-b71b-6fd105ffaaed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:45.177374 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff6b2b2b-74f3-4181-b71b-6fd105ffaaed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:45.177855 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff6b2b2b-74f3-4181-b71b-6fd105ffaaed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:45.178502 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff6b2b2b-74f3-4181-b71b-6fd105ffaaed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:45.178946 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff6b2b2b-74f3-4181-b71b-6fd105ffaaed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:45.179368 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff6b2b2b-74f3-4181-b71b-6fd105ffaaed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:45.319263 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff6b2b2b-74f3-4181-b71b-6fd105ffaaed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:45.328014 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff6b2b2b-74f3-4181-b71b-6fd105ffaaed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:45.329550 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff6b2b2b-74f3-4181-b71b-6fd105ffaaed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:45.330704 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ff6b2b2b-74f3-4181-b71b-6fd105ffaaed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.165430 Aug 24 09:02:45.331256 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 420/838] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:45 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:02:45.813930 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-be614b08-66d0-401d-a65a-a94c3a16e117 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:45.814635 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-be614b08-66d0-401d-a65a-a94c3a16e117 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:45.821122 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be614b08-66d0-401d-a65a-a94c3a16e117 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:45.821613 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be614b08-66d0-401d-a65a-a94c3a16e117 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:45.822053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be614b08-66d0-401d-a65a-a94c3a16e117 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:45.822771 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be614b08-66d0-401d-a65a-a94c3a16e117 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:45.823233 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be614b08-66d0-401d-a65a-a94c3a16e117 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:45.823660 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-be614b08-66d0-401d-a65a-a94c3a16e117 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:45.887420 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-be614b08-66d0-401d-a65a-a94c3a16e117 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:45.895059 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-be614b08-66d0-401d-a65a-a94c3a16e117 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1246 microversion: 2.1 time: 0.085507 Aug 24 09:02:45.895918 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 419/839] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:45 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:46.353430 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-75635098-f023-4aad-b90e-b31d0cc64d03 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:46.353973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-75635098-f023-4aad-b90e-b31d0cc64d03 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:46.360139 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75635098-f023-4aad-b90e-b31d0cc64d03 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:46.360620 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75635098-f023-4aad-b90e-b31d0cc64d03 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:46.361045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75635098-f023-4aad-b90e-b31d0cc64d03 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:46.361747 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75635098-f023-4aad-b90e-b31d0cc64d03 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:46.362183 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75635098-f023-4aad-b90e-b31d0cc64d03 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:46.363193 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75635098-f023-4aad-b90e-b31d0cc64d03 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:46.494045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-75635098-f023-4aad-b90e-b31d0cc64d03 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:46.502959 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-75635098-f023-4aad-b90e-b31d0cc64d03 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:46.504488 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-75635098-f023-4aad-b90e-b31d0cc64d03 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:46.505631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-75635098-f023-4aad-b90e-b31d0cc64d03 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.156159 Aug 24 09:02:46.506179 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 421/840] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:46 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:46.917205 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-159c12ff-556a-4a70-ae39-fdfa60c593b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:46.917819 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-159c12ff-556a-4a70-ae39-fdfa60c593b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:46.924600 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-159c12ff-556a-4a70-ae39-fdfa60c593b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:46.925091 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-159c12ff-556a-4a70-ae39-fdfa60c593b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:46.925548 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-159c12ff-556a-4a70-ae39-fdfa60c593b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:46.926247 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-159c12ff-556a-4a70-ae39-fdfa60c593b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:46.926704 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-159c12ff-556a-4a70-ae39-fdfa60c593b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:46.927132 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-159c12ff-556a-4a70-ae39-fdfa60c593b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:46.992446 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-159c12ff-556a-4a70-ae39-fdfa60c593b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:47.001674 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-159c12ff-556a-4a70-ae39-fdfa60c593b7 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1294 microversion: 2.1 time: 0.088358 Aug 24 09:02:47.002275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 420/841] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:46 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:47.529408 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ff811f1b-7c37-4d7b-8d3b-385429c3d3ce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:47.530028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ff811f1b-7c37-4d7b-8d3b-385429c3d3ce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:47.536284 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff811f1b-7c37-4d7b-8d3b-385429c3d3ce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:47.536706 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff811f1b-7c37-4d7b-8d3b-385429c3d3ce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:47.537145 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff811f1b-7c37-4d7b-8d3b-385429c3d3ce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:47.537884 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff811f1b-7c37-4d7b-8d3b-385429c3d3ce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:47.538344 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff811f1b-7c37-4d7b-8d3b-385429c3d3ce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:47.538776 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ff811f1b-7c37-4d7b-8d3b-385429c3d3ce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:47.869451 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff811f1b-7c37-4d7b-8d3b-385429c3d3ce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:47.878855 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff811f1b-7c37-4d7b-8d3b-385429c3d3ce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:47.880486 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ff811f1b-7c37-4d7b-8d3b-385429c3d3ce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:47.881733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ff811f1b-7c37-4d7b-8d3b-385429c3d3ce tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1720 microversion: 2.20 time: 0.356324 Aug 24 09:02:47.882293 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 422/842] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:47 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1720 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:48.023179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8b423f27-1056-4672-a53d-494ff7229c92 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:48.023810 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8b423f27-1056-4672-a53d-494ff7229c92 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:48.030383 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b423f27-1056-4672-a53d-494ff7229c92 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:48.031144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b423f27-1056-4672-a53d-494ff7229c92 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:48.031671 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b423f27-1056-4672-a53d-494ff7229c92 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:48.032408 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b423f27-1056-4672-a53d-494ff7229c92 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:48.032859 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b423f27-1056-4672-a53d-494ff7229c92 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:48.033279 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8b423f27-1056-4672-a53d-494ff7229c92 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:48.160562 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8b423f27-1056-4672-a53d-494ff7229c92 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:48.168192 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8b423f27-1056-4672-a53d-494ff7229c92 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1300 microversion: 2.1 time: 0.149111 Aug 24 09:02:48.168763 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 421/843] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:48 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1300 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:48.907285 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9d7bc4e5-5ac1-466b-9ce8-de89f25b961c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:48.908334 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9d7bc4e5-5ac1-466b-9ce8-de89f25b961c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:48.915145 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d7bc4e5-5ac1-466b-9ce8-de89f25b961c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:48.915891 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d7bc4e5-5ac1-466b-9ce8-de89f25b961c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:48.917289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d7bc4e5-5ac1-466b-9ce8-de89f25b961c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:48.917968 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d7bc4e5-5ac1-466b-9ce8-de89f25b961c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:48.918653 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d7bc4e5-5ac1-466b-9ce8-de89f25b961c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:48.919150 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9d7bc4e5-5ac1-466b-9ce8-de89f25b961c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:48.986877 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-5e74ff43-0ff0-42bf-9409-9795ee99e2b5 req-dee13908-49d6-45e6-b8de-11d6c4d2d361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4866e8f4-ddfe-4cee-8bcc-5db7372926f5", "name": "network-vif-deleted", "tag": "4e1f25c9-676d-433c-8c1b-ae79e13a1625"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:49.012527 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5e74ff43-0ff0-42bf-9409-9795ee99e2b5 req-dee13908-49d6-45e6-b8de-11d6c4d2d361 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:49.015325 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5e74ff43-0ff0-42bf-9409-9795ee99e2b5 req-dee13908-49d6-45e6-b8de-11d6c4d2d361 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:49.016535 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-5e74ff43-0ff0-42bf-9409-9795ee99e2b5 req-dee13908-49d6-45e6-b8de-11d6c4d2d361 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:49.039123 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-5e74ff43-0ff0-42bf-9409-9795ee99e2b5 req-dee13908-49d6-45e6-b8de-11d6c4d2d361 service nova] Creating event network-vif-deleted:4e1f25c9-676d-433c-8c1b-ae79e13a1625 for instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 on hv-cinder-83538 Aug 24 09:02:49.046552 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-5e74ff43-0ff0-42bf-9409-9795ee99e2b5 req-dee13908-49d6-45e6-b8de-11d6c4d2d361 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063955 Aug 24 09:02:49.048034 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 422/844] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:02:49.049170 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9d7bc4e5-5ac1-466b-9ce8-de89f25b961c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:49.063640 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9d7bc4e5-5ac1-466b-9ce8-de89f25b961c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:49.067224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9d7bc4e5-5ac1-466b-9ce8-de89f25b961c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:49.068446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9d7bc4e5-5ac1-466b-9ce8-de89f25b961c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 200 len: 1653 microversion: 2.20 time: 0.166490 Aug 24 09:02:49.080982 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 423/845] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:48 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 1653 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:49.194208 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6e58e0fc-562d-4e33-a11c-3557a3f36bb2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:49.195193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6e58e0fc-562d-4e33-a11c-3557a3f36bb2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:49.207054 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e58e0fc-562d-4e33-a11c-3557a3f36bb2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:49.207557 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e58e0fc-562d-4e33-a11c-3557a3f36bb2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:49.208000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e58e0fc-562d-4e33-a11c-3557a3f36bb2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:49.208757 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e58e0fc-562d-4e33-a11c-3557a3f36bb2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:49.209217 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e58e0fc-562d-4e33-a11c-3557a3f36bb2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:49.209642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6e58e0fc-562d-4e33-a11c-3557a3f36bb2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:49.397364 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-6e58e0fc-562d-4e33-a11c-3557a3f36bb2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:49.408662 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6e58e0fc-562d-4e33-a11c-3557a3f36bb2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1367 microversion: 2.1 time: 0.221283 Aug 24 09:02:49.410945 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 423/846] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:49 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:50.095908 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-69de4783-415a-4f16-8267-982848f77757 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:50.096829 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-69de4783-415a-4f16-8267-982848f77757 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:50.119252 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69de4783-415a-4f16-8267-982848f77757 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:50.119843 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69de4783-415a-4f16-8267-982848f77757 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:50.120220 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69de4783-415a-4f16-8267-982848f77757 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:50.122429 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69de4783-415a-4f16-8267-982848f77757 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:50.127633 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69de4783-415a-4f16-8267-982848f77757 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:50.128179 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69de4783-415a-4f16-8267-982848f77757 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:50.159434 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-69de4783-415a-4f16-8267-982848f77757 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] HTTP exception thrown: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-69de4783-415a-4f16-8267-982848f77757 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Request method failure captured: Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 HTTP/1.1 Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeeQU6uZPFeG01QEvK7InhHNu7ZJBw3451aN_mPEG1emv2IfRGP0oF-xEB7A2Lyum-HtdKYpfy_wQH-jlmjKOtCRTWyX4BbXtAJvqgolqYV7P1IlvpRWvCU2rjo8ZZZpmKlZ3g6ykazs52HXiYXii78tRBeD3USEcpPQlzlYckZAtUM Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: edeca01476604a70bed160e5aa97607c Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:02:50.161164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:02:50.162684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_edeca01476604a70bed160e5aa97607c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/edeca01476604a70bed160e5aa97607c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/edeca01476604a70bed160e5aa97607c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/edeca01476604a70bed160e5aa97607c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:02:50.162684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:02:50.162684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: edeca01476604a70bed160e5aa97607c Aug 24 09:02:50.162684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:02:50.162684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-AttachVolumeShelveTestJSON-1568880508-project Aug 24 09:02:50.162684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:02:50.162684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:02:50.162684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: f0d0eb9dc0f743c3985218901334b336 Aug 24 09:02:50.162684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1568880508-project Aug 24 09:02:50.162684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:02:50.162684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. Aug 24 09:02:50.162684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '4866e8f4-ddfe-4cee-8bcc-5db7372926f5'} Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:02:50.163446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. Aug 24 09:02:50.164668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:02:50.167254 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-69de4783-415a-4f16-8267-982848f77757 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Returning 404 to user: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:02:50.168370 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-69de4783-415a-4f16-8267-982848f77757 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 404 len: 111 microversion: 2.20 time: 0.077294 Aug 24 09:02:50.169311 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 424/847] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:50 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 09:02:50.178276 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-af1cfd40-b74a-466f-abbd-5ea258e3ae64 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '.version_select at 0x7fb14568cee0>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:50.203189 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-af1cfd40-b74a-466f-abbd-5ea258e3ae64 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-39258680" status: 204 len: 0 microversion: 2.20 time: 0.028654 Aug 24 09:02:50.204344 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 424/848] 10.222.0.67 () {60 vars in 1256 bytes} [Wed Aug 24 09:02:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-39258680 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 09:02:50.430819 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-75841ee3-e8a0-4732-a75a-308d49ff943d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:50.431436 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-75841ee3-e8a0-4732-a75a-308d49ff943d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:50.438171 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75841ee3-e8a0-4732-a75a-308d49ff943d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:50.439035 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75841ee3-e8a0-4732-a75a-308d49ff943d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:50.439672 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75841ee3-e8a0-4732-a75a-308d49ff943d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:50.440665 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75841ee3-e8a0-4732-a75a-308d49ff943d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:50.441357 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75841ee3-e8a0-4732-a75a-308d49ff943d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:50.442005 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75841ee3-e8a0-4732-a75a-308d49ff943d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:50.673848 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-75841ee3-e8a0-4732-a75a-308d49ff943d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:50.684623 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-75841ee3-e8a0-4732-a75a-308d49ff943d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1367 microversion: 2.1 time: 0.257560 Aug 24 09:02:50.685775 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 425/849] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:50 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:50.902715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-79ed2c87-1a1f-47be-81b7-73a3f3e361cb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Action: 'create', calling method: .version_select at 0x7fb1456060d0>, body: {"keypair": {"name": "tempest-keypair-1778024209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiTn7L18HEM3ka3ZxtbQPuUZ7XEqDnVL3bHAllmSVv6l8MJFtMhNfMK913L7DUOspVm923SKUbC8x1DlusWgtWA9W2XbrOTsbG0VYItY0inr+aMGZqMEvuTGsQON68Ezw=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:50.919180 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-79ed2c87-1a1f-47be-81b7-73a3f3e361cb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Getting quotas for project edeca01476604a70bed160e5aa97607c. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:02:50.923817 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-79ed2c87-1a1f-47be-81b7-73a3f3e361cb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Getting quotas for user f0d0eb9dc0f743c3985218901334b336 and project edeca01476604a70bed160e5aa97607c. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:02:50.947704 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-79ed2c87-1a1f-47be-81b7-73a3f3e361cb tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048881 Aug 24 09:02:50.948353 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 425/850] 10.222.0.67 () {62 vars in 1200 bytes} [Wed Aug 24 09:02:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 09:02:51.066024 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-75da9f90-fcb7-41a0-8118-cd51a560c2b7 req-09b4703a-5694-4eb8-931b-447b992bcaa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e", "tag": "41c1036f-bd6c-4b24-a83a-4bde96f59c6c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:51.075822 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-75da9f90-fcb7-41a0-8118-cd51a560c2b7 req-09b4703a-5694-4eb8-931b-447b992bcaa1 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:51.076994 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-75da9f90-fcb7-41a0-8118-cd51a560c2b7 req-09b4703a-5694-4eb8-931b-447b992bcaa1 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:51.077385 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-75da9f90-fcb7-41a0-8118-cd51a560c2b7 req-09b4703a-5694-4eb8-931b-447b992bcaa1 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:51.081563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:51.090486 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-75da9f90-fcb7-41a0-8118-cd51a560c2b7 req-09b4703a-5694-4eb8-931b-447b992bcaa1 service nova] Creating event network-changed:41c1036f-bd6c-4b24-a83a-4bde96f59c6c for instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e on hv-cinder-83538 Aug 24 09:02:51.097207 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-75da9f90-fcb7-41a0-8118-cd51a560c2b7 req-09b4703a-5694-4eb8-931b-447b992bcaa1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035203 Aug 24 09:02:51.098234 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 426/851] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:02:51.707515 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3f4a93d5-92f2-4d44-b2bb-32f9ff2c0dfc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:51.708299 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3f4a93d5-92f2-4d44-b2bb-32f9ff2c0dfc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:51.714233 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f4a93d5-92f2-4d44-b2bb-32f9ff2c0dfc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:51.714724 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f4a93d5-92f2-4d44-b2bb-32f9ff2c0dfc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:51.715162 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f4a93d5-92f2-4d44-b2bb-32f9ff2c0dfc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:51.715901 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f4a93d5-92f2-4d44-b2bb-32f9ff2c0dfc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:51.716354 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f4a93d5-92f2-4d44-b2bb-32f9ff2c0dfc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:51.716782 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f4a93d5-92f2-4d44-b2bb-32f9ff2c0dfc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:51.946529 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3f4a93d5-92f2-4d44-b2bb-32f9ff2c0dfc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:51.955020 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3f4a93d5-92f2-4d44-b2bb-32f9ff2c0dfc tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1367 microversion: 2.1 time: 0.251872 Aug 24 09:02:51.955592 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 426/852] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:51 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:52.344728 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-511330834", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aefdd75d-c13f-449c-a470-c3c20a8d011f"}], "security_groups": [{"name": "tempest-securitygroup--1892145259"}], "key_name": "tempest-keypair-1778024209", "user_data": "}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:52.458230 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] validate_networks() for [('aefdd75d-c13f-449c-a470-c3c20a8d011f', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:02:52.839716 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:02:52.840177 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:02:52.840661 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:02:52.841132 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:02:52.841485 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:02:52.851252 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:52.851652 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:52.852087 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:52.852847 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:52.853308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:52.853738 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:52.871281 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Getting quotas for project edeca01476604a70bed160e5aa97607c. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:02:52.875307 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Getting quotas for user f0d0eb9dc0f743c3985218901334b336 and project edeca01476604a70bed160e5aa97607c. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:02:52.886303 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:02:52.889599 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:02:52.938274 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3eb2ad38-31d1-400d-908c-d171b7fb51ee tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.599425 Aug 24 09:02:52.938913 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 427/853] 10.222.0.67 () {62 vars in 1188 bytes} [Wed Aug 24 09:02:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 09:02:52.949580 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-77940214-c11b-4949-9ba2-9978cc8c25f2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:52.950185 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-77940214-c11b-4949-9ba2-9978cc8c25f2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:52.975597 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9f403db-e0c3-43f2-b69a-554e00e0241a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:52.976266 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9f403db-e0c3-43f2-b69a-554e00e0241a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:52.985558 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9f403db-e0c3-43f2-b69a-554e00e0241a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:52.986059 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9f403db-e0c3-43f2-b69a-554e00e0241a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:52.986503 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9f403db-e0c3-43f2-b69a-554e00e0241a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:52.987213 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9f403db-e0c3-43f2-b69a-554e00e0241a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:52.987676 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9f403db-e0c3-43f2-b69a-554e00e0241a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:52.988148 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9f403db-e0c3-43f2-b69a-554e00e0241a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:53.011390 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-77940214-c11b-4949-9ba2-9978cc8c25f2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:53.020159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-77940214-c11b-4949-9ba2-9978cc8c25f2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:53.021961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-77940214-c11b-4949-9ba2-9978cc8c25f2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:53.023116 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-77940214-c11b-4949-9ba2-9978cc8c25f2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1281 microversion: 2.20 time: 0.077363 Aug 24 09:02:53.023671 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 427/854] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:52 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1281 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:53.138029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9f403db-e0c3-43f2-b69a-554e00e0241a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:53.146574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9f403db-e0c3-43f2-b69a-554e00e0241a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1367 microversion: 2.1 time: 0.174916 Aug 24 09:02:53.147133 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 428/855] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:52 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:54.054379 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e91ae526-cf5b-42bc-86ee-ad980b9b69f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:54.055554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e91ae526-cf5b-42bc-86ee-ad980b9b69f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:54.064133 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e91ae526-cf5b-42bc-86ee-ad980b9b69f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:54.064646 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e91ae526-cf5b-42bc-86ee-ad980b9b69f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:54.065265 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e91ae526-cf5b-42bc-86ee-ad980b9b69f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:54.065968 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e91ae526-cf5b-42bc-86ee-ad980b9b69f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:54.066422 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e91ae526-cf5b-42bc-86ee-ad980b9b69f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:54.066846 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e91ae526-cf5b-42bc-86ee-ad980b9b69f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:54.139897 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e91ae526-cf5b-42bc-86ee-ad980b9b69f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:54.148595 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e91ae526-cf5b-42bc-86ee-ad980b9b69f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:54.150099 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e91ae526-cf5b-42bc-86ee-ad980b9b69f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:54.151199 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e91ae526-cf5b-42bc-86ee-ad980b9b69f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1339 microversion: 2.20 time: 0.108917 Aug 24 09:02:54.151742 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 428/856] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:54 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1339 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:02:54.167923 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7a6edb58-826a-4fb1-8779-d1f7bbd13d98 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:54.168641 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7a6edb58-826a-4fb1-8779-d1f7bbd13d98 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:54.175368 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a6edb58-826a-4fb1-8779-d1f7bbd13d98 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:54.175988 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a6edb58-826a-4fb1-8779-d1f7bbd13d98 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:54.176522 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a6edb58-826a-4fb1-8779-d1f7bbd13d98 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:54.177287 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a6edb58-826a-4fb1-8779-d1f7bbd13d98 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:54.177779 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a6edb58-826a-4fb1-8779-d1f7bbd13d98 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:54.178200 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7a6edb58-826a-4fb1-8779-d1f7bbd13d98 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:54.380365 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7a6edb58-826a-4fb1-8779-d1f7bbd13d98 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:54.389742 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7a6edb58-826a-4fb1-8779-d1f7bbd13d98 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1367 microversion: 2.1 time: 0.225184 Aug 24 09:02:54.390821 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 429/857] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:54 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:55.175468 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-41f5d06b-5160-4edc-a0e8-b950668010aa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:55.176310 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-41f5d06b-5160-4edc-a0e8-b950668010aa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:55.184077 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f5d06b-5160-4edc-a0e8-b950668010aa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:55.184689 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f5d06b-5160-4edc-a0e8-b950668010aa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:55.185196 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f5d06b-5160-4edc-a0e8-b950668010aa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:55.186913 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f5d06b-5160-4edc-a0e8-b950668010aa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:55.187406 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f5d06b-5160-4edc-a0e8-b950668010aa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:55.187907 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-41f5d06b-5160-4edc-a0e8-b950668010aa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:55.413890 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-984a7821-f1d7-4c8e-ae33-5ec608c0b6fe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:55.414526 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-984a7821-f1d7-4c8e-ae33-5ec608c0b6fe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:55.421951 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-984a7821-f1d7-4c8e-ae33-5ec608c0b6fe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:55.422450 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-984a7821-f1d7-4c8e-ae33-5ec608c0b6fe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:55.422804 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-984a7821-f1d7-4c8e-ae33-5ec608c0b6fe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:55.423525 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-984a7821-f1d7-4c8e-ae33-5ec608c0b6fe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:55.423986 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-984a7821-f1d7-4c8e-ae33-5ec608c0b6fe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:55.424436 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-984a7821-f1d7-4c8e-ae33-5ec608c0b6fe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:55.435847 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-41f5d06b-5160-4edc-a0e8-b950668010aa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:55.445904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-41f5d06b-5160-4edc-a0e8-b950668010aa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:55.447801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-41f5d06b-5160-4edc-a0e8-b950668010aa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:55.449026 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-41f5d06b-5160-4edc-a0e8-b950668010aa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1407 microversion: 2.20 time: 0.278839 Aug 24 09:02:55.449575 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 429/858] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:55 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:55.626596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4f017291-4b86-4143-ac8d-bbf16f22bd75 req-5054d176-cffb-44f0-8aeb-1800c4a1977d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e05dfbb2-5e47-4ddf-897d-10e19be499ca", "tag": "ca6a6a1a-7c92-4d61-9b26-4ffea23e5485"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:55.638746 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4f017291-4b86-4143-ac8d-bbf16f22bd75 req-5054d176-cffb-44f0-8aeb-1800c4a1977d service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:55.639247 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4f017291-4b86-4143-ac8d-bbf16f22bd75 req-5054d176-cffb-44f0-8aeb-1800c4a1977d service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:55.640214 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4f017291-4b86-4143-ac8d-bbf16f22bd75 req-5054d176-cffb-44f0-8aeb-1800c4a1977d service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:55.651180 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-984a7821-f1d7-4c8e-ae33-5ec608c0b6fe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:55.651827 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4f017291-4b86-4143-ac8d-bbf16f22bd75 req-5054d176-cffb-44f0-8aeb-1800c4a1977d service nova] Creating event network-changed:ca6a6a1a-7c92-4d61-9b26-4ffea23e5485 for instance e05dfbb2-5e47-4ddf-897d-10e19be499ca on hv-cinder-83538 Aug 24 09:02:55.657441 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4f017291-4b86-4143-ac8d-bbf16f22bd75 req-5054d176-cffb-44f0-8aeb-1800c4a1977d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035392 Aug 24 09:02:55.658649 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 430/859] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:02:55.660640 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-984a7821-f1d7-4c8e-ae33-5ec608c0b6fe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1367 microversion: 2.1 time: 0.250526 Aug 24 09:02:55.661294 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 430/860] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:55 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:02:56.472631 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0e781f70-a77f-4a9e-8476-9f81a5abe323 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:56.473327 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0e781f70-a77f-4a9e-8476-9f81a5abe323 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:56.480331 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e781f70-a77f-4a9e-8476-9f81a5abe323 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:56.480820 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e781f70-a77f-4a9e-8476-9f81a5abe323 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:56.481257 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e781f70-a77f-4a9e-8476-9f81a5abe323 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:56.481954 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e781f70-a77f-4a9e-8476-9f81a5abe323 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:56.482412 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e781f70-a77f-4a9e-8476-9f81a5abe323 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:56.483472 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0e781f70-a77f-4a9e-8476-9f81a5abe323 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:56.618302 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0e781f70-a77f-4a9e-8476-9f81a5abe323 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:56.626845 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0e781f70-a77f-4a9e-8476-9f81a5abe323 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:56.628498 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0e781f70-a77f-4a9e-8476-9f81a5abe323 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:56.629704 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0e781f70-a77f-4a9e-8476-9f81a5abe323 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1407 microversion: 2.20 time: 0.161771 Aug 24 09:02:56.630375 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 431/861] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:56 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:56.682607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ab54300a-d0de-4af5-a7fa-fb14ceca0e64 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:56.683226 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ab54300a-d0de-4af5-a7fa-fb14ceca0e64 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:56.689478 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab54300a-d0de-4af5-a7fa-fb14ceca0e64 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:56.689971 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab54300a-d0de-4af5-a7fa-fb14ceca0e64 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:56.690414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab54300a-d0de-4af5-a7fa-fb14ceca0e64 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:56.691123 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab54300a-d0de-4af5-a7fa-fb14ceca0e64 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:56.691587 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab54300a-d0de-4af5-a7fa-fb14ceca0e64 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:56.692008 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab54300a-d0de-4af5-a7fa-fb14ceca0e64 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:56.776210 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-67f46238-079f-4c4a-9e84-5615c9199efc req-6a4ced3a-39b6-418b-90df-430c0ca30634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e", "name": "network-vif-plugged", "status": "completed", "tag": "41c1036f-bd6c-4b24-a83a-4bde96f59c6c"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:02:56.786815 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-67f46238-079f-4c4a-9e84-5615c9199efc req-6a4ced3a-39b6-418b-90df-430c0ca30634 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:56.787297 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-67f46238-079f-4c4a-9e84-5615c9199efc req-6a4ced3a-39b6-418b-90df-430c0ca30634 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:56.787724 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-67f46238-079f-4c4a-9e84-5615c9199efc req-6a4ced3a-39b6-418b-90df-430c0ca30634 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:56.799576 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-67f46238-079f-4c4a-9e84-5615c9199efc req-6a4ced3a-39b6-418b-90df-430c0ca30634 service nova] Creating event network-vif-plugged:41c1036f-bd6c-4b24-a83a-4bde96f59c6c for instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e on hv-cinder-83538 Aug 24 09:02:56.804400 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-67f46238-079f-4c4a-9e84-5615c9199efc req-6a4ced3a-39b6-418b-90df-430c0ca30634 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100684 Aug 24 09:02:56.804987 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 432/862] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:02:56.852998 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ab54300a-d0de-4af5-a7fa-fb14ceca0e64 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:56.861569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ab54300a-d0de-4af5-a7fa-fb14ceca0e64 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1367 microversion: 2.1 time: 0.182842 Aug 24 09:02:56.862140 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 431/863] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:56 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:57.653307 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4e6db694-6622-4528-8a77-e3a47ff4f7c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:57.654006 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4e6db694-6622-4528-8a77-e3a47ff4f7c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:57.660888 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e6db694-6622-4528-8a77-e3a47ff4f7c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:57.661374 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e6db694-6622-4528-8a77-e3a47ff4f7c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:57.661814 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e6db694-6622-4528-8a77-e3a47ff4f7c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:57.662517 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e6db694-6622-4528-8a77-e3a47ff4f7c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:57.662966 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e6db694-6622-4528-8a77-e3a47ff4f7c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:57.663392 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4e6db694-6622-4528-8a77-e3a47ff4f7c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:57.794031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-4e6db694-6622-4528-8a77-e3a47ff4f7c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:57.802426 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-4e6db694-6622-4528-8a77-e3a47ff4f7c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:57.803975 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-4e6db694-6622-4528-8a77-e3a47ff4f7c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:57.805129 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4e6db694-6622-4528-8a77-e3a47ff4f7c1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1407 microversion: 2.20 time: 0.156639 Aug 24 09:02:57.805692 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 433/864] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:57 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:57.882839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5d207df2-ac23-49e4-8661-29eeae468b2f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:57.883445 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5d207df2-ac23-49e4-8661-29eeae468b2f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:57.886519 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:57.891631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d207df2-ac23-49e4-8661-29eeae468b2f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:57.892150 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d207df2-ac23-49e4-8661-29eeae468b2f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:57.892602 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d207df2-ac23-49e4-8661-29eeae468b2f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:57.893303 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d207df2-ac23-49e4-8661-29eeae468b2f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:57.893761 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d207df2-ac23-49e4-8661-29eeae468b2f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:57.894198 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d207df2-ac23-49e4-8661-29eeae468b2f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:58.027644 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5d207df2-ac23-49e4-8661-29eeae468b2f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:58.035314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5d207df2-ac23-49e4-8661-29eeae468b2f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1367 microversion: 2.1 time: 0.156399 Aug 24 09:02:58.035879 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 432/865] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:57 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:02:58.828431 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7cbc9373-ea5c-44b8-95e3-eda2dabd490e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:58.829050 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7cbc9373-ea5c-44b8-95e3-eda2dabd490e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:58.832600 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:58.836862 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cbc9373-ea5c-44b8-95e3-eda2dabd490e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:58.837354 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cbc9373-ea5c-44b8-95e3-eda2dabd490e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:58.837810 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cbc9373-ea5c-44b8-95e3-eda2dabd490e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:58.838489 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cbc9373-ea5c-44b8-95e3-eda2dabd490e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:58.838943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cbc9373-ea5c-44b8-95e3-eda2dabd490e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:58.839365 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7cbc9373-ea5c-44b8-95e3-eda2dabd490e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:59.005527 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7cbc9373-ea5c-44b8-95e3-eda2dabd490e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:59.013712 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7cbc9373-ea5c-44b8-95e3-eda2dabd490e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:59.015953 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7cbc9373-ea5c-44b8-95e3-eda2dabd490e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:59.017085 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7cbc9373-ea5c-44b8-95e3-eda2dabd490e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1407 microversion: 2.20 time: 0.192829 Aug 24 09:02:59.017670 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 434/866] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:02:58 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:02:59.055598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-94626c9a-3a96-4054-9b0d-d76ffaa874e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:02:59.056241 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-94626c9a-3a96-4054-9b0d-d76ffaa874e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:02:59.062594 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94626c9a-3a96-4054-9b0d-d76ffaa874e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:59.063082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94626c9a-3a96-4054-9b0d-d76ffaa874e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:59.063520 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94626c9a-3a96-4054-9b0d-d76ffaa874e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:59.064258 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94626c9a-3a96-4054-9b0d-d76ffaa874e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:02:59.064720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94626c9a-3a96-4054-9b0d-d76ffaa874e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:02:59.065149 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94626c9a-3a96-4054-9b0d-d76ffaa874e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:02:59.197939 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-94626c9a-3a96-4054-9b0d-d76ffaa874e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:02:59.206211 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-94626c9a-3a96-4054-9b0d-d76ffaa874e2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1367 microversion: 2.1 time: 0.154433 Aug 24 09:02:59.206778 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 433/867] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:02:59 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:00.040411 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-627065c7-6107-4466-9599-c5a73e019437 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:00.041019 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-627065c7-6107-4466-9599-c5a73e019437 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:00.047824 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-627065c7-6107-4466-9599-c5a73e019437 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:00.048367 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-627065c7-6107-4466-9599-c5a73e019437 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:00.048802 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-627065c7-6107-4466-9599-c5a73e019437 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:00.049499 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-627065c7-6107-4466-9599-c5a73e019437 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:00.049954 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-627065c7-6107-4466-9599-c5a73e019437 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:00.050378 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-627065c7-6107-4466-9599-c5a73e019437 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:00.180717 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-627065c7-6107-4466-9599-c5a73e019437 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:00.189752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-627065c7-6107-4466-9599-c5a73e019437 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:00.191263 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-627065c7-6107-4466-9599-c5a73e019437 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:00.192414 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-627065c7-6107-4466-9599-c5a73e019437 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1407 microversion: 2.20 time: 0.155914 Aug 24 09:03:00.192970 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 435/868] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:03:00 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:03:00.227351 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21157452-89bd-4f39-a076-7da128813821 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:00.227965 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-21157452-89bd-4f39-a076-7da128813821 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:00.234261 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21157452-89bd-4f39-a076-7da128813821 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:00.234745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21157452-89bd-4f39-a076-7da128813821 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:00.235185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21157452-89bd-4f39-a076-7da128813821 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:00.235885 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21157452-89bd-4f39-a076-7da128813821 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:00.236376 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21157452-89bd-4f39-a076-7da128813821 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:00.236807 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21157452-89bd-4f39-a076-7da128813821 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:00.369709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-21157452-89bd-4f39-a076-7da128813821 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:00.378046 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-21157452-89bd-4f39-a076-7da128813821 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1367 microversion: 2.1 time: 0.154540 Aug 24 09:03:00.378631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 434/869] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:00 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:01.020597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6f2a5bf6-44c9-4e14-b658-05dcd29aefe5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:01.021017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6f2a5bf6-44c9-4e14-b658-05dcd29aefe5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:01.027260 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f2a5bf6-44c9-4e14-b658-05dcd29aefe5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:01.027749 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f2a5bf6-44c9-4e14-b658-05dcd29aefe5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:01.028213 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f2a5bf6-44c9-4e14-b658-05dcd29aefe5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:01.028908 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f2a5bf6-44c9-4e14-b658-05dcd29aefe5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:01.029368 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f2a5bf6-44c9-4e14-b658-05dcd29aefe5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:01.030314 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6f2a5bf6-44c9-4e14-b658-05dcd29aefe5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:01.056298 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6f2a5bf6-44c9-4e14-b658-05dcd29aefe5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:03:01.133810 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6f2a5bf6-44c9-4e14-b658-05dcd29aefe5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 204 len: 0 microversion: 2.1 time: 0.116974 Aug 24 09:03:01.134387 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 436/870] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:03:01 2022] DELETE /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:03:01.144579 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-197ef012-508b-456a-97ce-6470968b9adb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:01.145186 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-197ef012-508b-456a-97ce-6470968b9adb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:01.151452 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-197ef012-508b-456a-97ce-6470968b9adb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:01.152128 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-197ef012-508b-456a-97ce-6470968b9adb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:01.152613 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-197ef012-508b-456a-97ce-6470968b9adb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:01.154800 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-197ef012-508b-456a-97ce-6470968b9adb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:01.156190 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-197ef012-508b-456a-97ce-6470968b9adb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:01.156638 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-197ef012-508b-456a-97ce-6470968b9adb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:01.215600 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b44f340e-9760-4f37-8f8d-026f4465ed7b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:01.216338 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b44f340e-9760-4f37-8f8d-026f4465ed7b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:01.223734 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b44f340e-9760-4f37-8f8d-026f4465ed7b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:01.223912 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b44f340e-9760-4f37-8f8d-026f4465ed7b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:01.224388 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b44f340e-9760-4f37-8f8d-026f4465ed7b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:01.225107 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b44f340e-9760-4f37-8f8d-026f4465ed7b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:01.225635 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b44f340e-9760-4f37-8f8d-026f4465ed7b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:01.226084 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b44f340e-9760-4f37-8f8d-026f4465ed7b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:01.342035 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-197ef012-508b-456a-97ce-6470968b9adb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:01.350763 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-197ef012-508b-456a-97ce-6470968b9adb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1578 microversion: 2.1 time: 0.212033 Aug 24 09:03:01.351344 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 435/871] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:01 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1578 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:01.390948 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b44f340e-9760-4f37-8f8d-026f4465ed7b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:01.399041 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c235446b-e69e-48e8-915e-ea99c05d1cc3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:01.399652 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c235446b-e69e-48e8-915e-ea99c05d1cc3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:01.400247 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b44f340e-9760-4f37-8f8d-026f4465ed7b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:01.401856 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b44f340e-9760-4f37-8f8d-026f4465ed7b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:01.403074 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b44f340e-9760-4f37-8f8d-026f4465ed7b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1407 microversion: 2.20 time: 0.191926 Aug 24 09:03:01.403917 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 437/872] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:03:01 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:03:01.406840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c235446b-e69e-48e8-915e-ea99c05d1cc3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:01.407331 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c235446b-e69e-48e8-915e-ea99c05d1cc3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:01.407798 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c235446b-e69e-48e8-915e-ea99c05d1cc3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:01.408532 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c235446b-e69e-48e8-915e-ea99c05d1cc3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:01.408994 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c235446b-e69e-48e8-915e-ea99c05d1cc3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:01.409421 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c235446b-e69e-48e8-915e-ea99c05d1cc3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:01.543034 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c235446b-e69e-48e8-915e-ea99c05d1cc3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:01.550993 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c235446b-e69e-48e8-915e-ea99c05d1cc3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1556 microversion: 2.1 time: 0.156070 Aug 24 09:03:01.551555 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 436/873] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:01 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:01.572108 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1be0f1d9-829c-47fc-afeb-8c205a52b2ae tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:01.572618 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1be0f1d9-829c-47fc-afeb-8c205a52b2ae tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:01.579181 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be0f1d9-829c-47fc-afeb-8c205a52b2ae tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:01.579671 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be0f1d9-829c-47fc-afeb-8c205a52b2ae tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:01.580444 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be0f1d9-829c-47fc-afeb-8c205a52b2ae tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:01.580861 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be0f1d9-829c-47fc-afeb-8c205a52b2ae tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:01.581629 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be0f1d9-829c-47fc-afeb-8c205a52b2ae tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:01.581753 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be0f1d9-829c-47fc-afeb-8c205a52b2ae tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:01.585986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:01.661337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1be0f1d9-829c-47fc-afeb-8c205a52b2ae tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093112 Aug 24 09:03:01.661935 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 438/874] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 24 09:03:01 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:02.371654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4c12d7f0-caa4-4ef0-87b9-6d654ac6108c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:02.372427 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4c12d7f0-caa4-4ef0-87b9-6d654ac6108c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:02.378507 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c12d7f0-caa4-4ef0-87b9-6d654ac6108c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:02.378985 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c12d7f0-caa4-4ef0-87b9-6d654ac6108c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:02.379416 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c12d7f0-caa4-4ef0-87b9-6d654ac6108c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:02.380130 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c12d7f0-caa4-4ef0-87b9-6d654ac6108c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:02.380608 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c12d7f0-caa4-4ef0-87b9-6d654ac6108c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:02.381030 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4c12d7f0-caa4-4ef0-87b9-6d654ac6108c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:02.426681 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9530626e-5aa9-4e1b-954c-6bc995ccbafd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:02.427500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9530626e-5aa9-4e1b-954c-6bc995ccbafd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:02.433650 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9530626e-5aa9-4e1b-954c-6bc995ccbafd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:02.434138 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9530626e-5aa9-4e1b-954c-6bc995ccbafd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:02.434572 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9530626e-5aa9-4e1b-954c-6bc995ccbafd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:02.435278 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9530626e-5aa9-4e1b-954c-6bc995ccbafd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:02.435764 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9530626e-5aa9-4e1b-954c-6bc995ccbafd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:02.436245 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9530626e-5aa9-4e1b-954c-6bc995ccbafd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:02.611683 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-4c12d7f0-caa4-4ef0-87b9-6d654ac6108c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:02.620999 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4c12d7f0-caa4-4ef0-87b9-6d654ac6108c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1578 microversion: 2.1 time: 0.253196 Aug 24 09:03:02.635596 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 437/875] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:02 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1578 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:02.705617 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9530626e-5aa9-4e1b-954c-6bc995ccbafd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:02.717104 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9530626e-5aa9-4e1b-954c-6bc995ccbafd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:02.720077 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9530626e-5aa9-4e1b-954c-6bc995ccbafd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:02.721446 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9530626e-5aa9-4e1b-954c-6bc995ccbafd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1407 microversion: 2.20 time: 0.299132 Aug 24 09:03:02.737732 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 439/876] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:03:02 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:03:02.769780 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-529fe484-a582-445c-a867-f929d4226b71 req-9ad2359e-7950-49a2-8fa5-bfa1b14ec530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05dfbb2-5e47-4ddf-897d-10e19be499ca", "name": "network-vif-plugged", "status": "completed", "tag": "ca6a6a1a-7c92-4d61-9b26-4ffea23e5485"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:02.788276 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-529fe484-a582-445c-a867-f929d4226b71 req-9ad2359e-7950-49a2-8fa5-bfa1b14ec530 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:02.788767 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-529fe484-a582-445c-a867-f929d4226b71 req-9ad2359e-7950-49a2-8fa5-bfa1b14ec530 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:02.789201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-529fe484-a582-445c-a867-f929d4226b71 req-9ad2359e-7950-49a2-8fa5-bfa1b14ec530 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:02.791515 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-35311b49-1a32-43a9-9327-b9ce34216116 req-213b2900-7dbc-4408-9033-d8314446bf48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e", "tag": "41c1036f-bd6c-4b24-a83a-4bde96f59c6c"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:02.802203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-35311b49-1a32-43a9-9327-b9ce34216116 req-213b2900-7dbc-4408-9033-d8314446bf48 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:02.803515 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-35311b49-1a32-43a9-9327-b9ce34216116 req-213b2900-7dbc-4408-9033-d8314446bf48 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:02.805334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-35311b49-1a32-43a9-9327-b9ce34216116 req-213b2900-7dbc-4408-9033-d8314446bf48 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:02.812488 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-529fe484-a582-445c-a867-f929d4226b71 req-9ad2359e-7950-49a2-8fa5-bfa1b14ec530 service nova] Creating event network-vif-plugged:ca6a6a1a-7c92-4d61-9b26-4ffea23e5485 for instance e05dfbb2-5e47-4ddf-897d-10e19be499ca on hv-cinder-83538 Aug 24 09:03:02.819200 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-529fe484-a582-445c-a867-f929d4226b71 req-9ad2359e-7950-49a2-8fa5-bfa1b14ec530 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054442 Aug 24 09:03:02.820446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 438/877] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:02.820560 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-35311b49-1a32-43a9-9327-b9ce34216116 req-213b2900-7dbc-4408-9033-d8314446bf48 service nova] Creating event network-changed:41c1036f-bd6c-4b24-a83a-4bde96f59c6c for instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e on hv-cinder-83538 Aug 24 09:03:02.825653 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-35311b49-1a32-43a9-9327-b9ce34216116 req-213b2900-7dbc-4408-9033-d8314446bf48 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037904 Aug 24 09:03:02.826515 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 440/878] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:03:03.644717 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3fc044e0-879c-4ffc-a5fb-e03cfb69f5bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:03.645650 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3fc044e0-879c-4ffc-a5fb-e03cfb69f5bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:03.648233 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:03.649184 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=16 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:03.658588 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fc044e0-879c-4ffc-a5fb-e03cfb69f5bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:03.659675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fc044e0-879c-4ffc-a5fb-e03cfb69f5bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:03.660580 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fc044e0-879c-4ffc-a5fb-e03cfb69f5bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:03.661419 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fc044e0-879c-4ffc-a5fb-e03cfb69f5bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:03.662036 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fc044e0-879c-4ffc-a5fb-e03cfb69f5bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:03.662602 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3fc044e0-879c-4ffc-a5fb-e03cfb69f5bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:03.744367 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=8 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:03.750144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c7bc5e6-bf56-4459-b40c-71cdb7dedd63 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:03.750847 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1c7bc5e6-bf56-4459-b40c-71cdb7dedd63 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:03.757759 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c7bc5e6-bf56-4459-b40c-71cdb7dedd63 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:03.758645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c7bc5e6-bf56-4459-b40c-71cdb7dedd63 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:03.759242 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c7bc5e6-bf56-4459-b40c-71cdb7dedd63 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:03.760131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c7bc5e6-bf56-4459-b40c-71cdb7dedd63 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:03.760737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c7bc5e6-bf56-4459-b40c-71cdb7dedd63 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:03.761307 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c7bc5e6-bf56-4459-b40c-71cdb7dedd63 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:03.955722 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3fc044e0-879c-4ffc-a5fb-e03cfb69f5bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:03.963834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3fc044e0-879c-4ffc-a5fb-e03cfb69f5bd tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1578 microversion: 2.1 time: 0.324646 Aug 24 09:03:03.964545 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 439/879] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:03 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1578 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:04.059140 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1c7bc5e6-bf56-4459-b40c-71cdb7dedd63 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:04.068030 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1c7bc5e6-bf56-4459-b40c-71cdb7dedd63 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:04.069590 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1c7bc5e6-bf56-4459-b40c-71cdb7dedd63 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:04.070751 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1c7bc5e6-bf56-4459-b40c-71cdb7dedd63 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1407 microversion: 2.20 time: 0.327412 Aug 24 09:03:04.071312 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 441/880] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:03:03 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1407 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:03:04.841028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-33ab309a-0d7b-4485-bd79-193e04a9c529 req-1374179d-2f0c-42b9-b6eb-24e536dd6a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dff703e-fd9a-4783-9b0d-98337571e993", "name": "network-vif-deleted", "tag": "7996caca-db82-4075-943a-f06676d4fa8c"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:04.850722 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-33ab309a-0d7b-4485-bd79-193e04a9c529 req-1374179d-2f0c-42b9-b6eb-24e536dd6a06 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:04.851197 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-33ab309a-0d7b-4485-bd79-193e04a9c529 req-1374179d-2f0c-42b9-b6eb-24e536dd6a06 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:04.851703 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-33ab309a-0d7b-4485-bd79-193e04a9c529 req-1374179d-2f0c-42b9-b6eb-24e536dd6a06 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:04.864159 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-33ab309a-0d7b-4485-bd79-193e04a9c529 req-1374179d-2f0c-42b9-b6eb-24e536dd6a06 service nova] Creating event network-vif-deleted:7996caca-db82-4075-943a-f06676d4fa8c for instance 2dff703e-fd9a-4783-9b0d-98337571e993 on hv-cinder-83538 Aug 24 09:03:04.868995 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-33ab309a-0d7b-4485-bd79-193e04a9c529 req-1374179d-2f0c-42b9-b6eb-24e536dd6a06 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031668 Aug 24 09:03:04.869666 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 440/881] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:04.986007 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8727f53e-6c35-4fd4-bdb9-bbe194a16a4c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:04.986612 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8727f53e-6c35-4fd4-bdb9-bbe194a16a4c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:04.993192 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8727f53e-6c35-4fd4-bdb9-bbe194a16a4c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:04.993712 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8727f53e-6c35-4fd4-bdb9-bbe194a16a4c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:04.994177 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8727f53e-6c35-4fd4-bdb9-bbe194a16a4c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:04.994876 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8727f53e-6c35-4fd4-bdb9-bbe194a16a4c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:04.995269 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8727f53e-6c35-4fd4-bdb9-bbe194a16a4c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:04.995691 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8727f53e-6c35-4fd4-bdb9-bbe194a16a4c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:05.030222 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8727f53e-6c35-4fd4-bdb9-bbe194a16a4c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:05.030725 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8727f53e-6c35-4fd4-bdb9-bbe194a16a4c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:05.031173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8727f53e-6c35-4fd4-bdb9-bbe194a16a4c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:05.031662 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-8727f53e-6c35-4fd4-bdb9-bbe194a16a4c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lazy-loading 'fault' on Instance uuid 2dff703e-fd9a-4783-9b0d-98337571e993 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:03:05.075859 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8727f53e-6c35-4fd4-bdb9-bbe194a16a4c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:05.084174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8727f53e-6c35-4fd4-bdb9-bbe194a16a4c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 200 len: 1231 microversion: 2.1 time: 0.102548 Aug 24 09:03:05.084769 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 442/882] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:04 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:05.094167 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9fd940c-6ead-4846-83f3-bc3b95c62772 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:05.094988 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c9fd940c-6ead-4846-83f3-bc3b95c62772 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:05.101192 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9fd940c-6ead-4846-83f3-bc3b95c62772 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:05.101674 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9fd940c-6ead-4846-83f3-bc3b95c62772 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:05.102105 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9fd940c-6ead-4846-83f3-bc3b95c62772 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:05.102789 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9fd940c-6ead-4846-83f3-bc3b95c62772 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:05.103237 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9fd940c-6ead-4846-83f3-bc3b95c62772 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:05.103656 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9fd940c-6ead-4846-83f3-bc3b95c62772 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:05.252009 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c9fd940c-6ead-4846-83f3-bc3b95c62772 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:05.261694 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c9fd940c-6ead-4846-83f3-bc3b95c62772 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:05.263208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c9fd940c-6ead-4846-83f3-bc3b95c62772 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:05.264460 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c9fd940c-6ead-4846-83f3-bc3b95c62772 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1599 microversion: 2.20 time: 0.174865 Aug 24 09:03:05.265364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 441/883] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:03:05 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:03:05.288643 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2abbc3a5-a1e3-46e4-80af-763f7fa2a768 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:05.289292 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2abbc3a5-a1e3-46e4-80af-763f7fa2a768 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:05.295526 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2abbc3a5-a1e3-46e4-80af-763f7fa2a768 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:05.296811 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2abbc3a5-a1e3-46e4-80af-763f7fa2a768 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:05.297250 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2abbc3a5-a1e3-46e4-80af-763f7fa2a768 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:05.297959 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2abbc3a5-a1e3-46e4-80af-763f7fa2a768 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:05.298451 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2abbc3a5-a1e3-46e4-80af-763f7fa2a768 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:05.298882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2abbc3a5-a1e3-46e4-80af-763f7fa2a768 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:05.386593 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2abbc3a5-a1e3-46e4-80af-763f7fa2a768 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102043 Aug 24 09:03:05.387200 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 443/884] 10.222.0.67 () {60 vars in 1316 bytes} [Wed Aug 24 09:03:05 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:03:06.105260 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5b47f5b3-88b2-471c-a591-197a5959fd1b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:06.105790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5b47f5b3-88b2-471c-a591-197a5959fd1b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:06.113319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b47f5b3-88b2-471c-a591-197a5959fd1b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:06.113810 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b47f5b3-88b2-471c-a591-197a5959fd1b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:06.114274 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b47f5b3-88b2-471c-a591-197a5959fd1b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:06.115023 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b47f5b3-88b2-471c-a591-197a5959fd1b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:06.115481 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b47f5b3-88b2-471c-a591-197a5959fd1b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:06.115906 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5b47f5b3-88b2-471c-a591-197a5959fd1b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:06.130615 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-5b47f5b3-88b2-471c-a591-197a5959fd1b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] HTTP exception thrown: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5b47f5b3-88b2-471c-a591-197a5959fd1b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Request method failure captured: Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 HTTP/1.1 Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBehQP1-444gnAzmK9UQR4_th7rQi9XkjPsGddXguVxoM6DfO-6Y6_ugun1cxR9pwbQU4JgRB7flDoSVAyavcw1wGkpOoK3OpeevRkCHbiSiOygkHn6SfhueR2e25MkBBDyhsNp-eP8UN9VZ76jrnXAkSpDI44B_q4oCM73ny0HXP3Zc Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 080318594f144fa3852577bc02ee5357 Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-TestVolumeBootPattern-9404766 Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:03:06.132289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:03:06.133869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_080318594f144fa3852577bc02ee5357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/080318594f144fa3852577bc02ee5357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/080318594f144fa3852577bc02ee5357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/080318594f144fa3852577bc02ee5357"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:03:06.133869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-TestVolumeBootPattern-9404766 Aug 24 09:03:06.133869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 080318594f144fa3852577bc02ee5357 Aug 24 09:03:06.133869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestVolumeBootPattern-9404766 Aug 24 09:03:06.133869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-TestVolumeBootPattern-9404766-project Aug 24 09:03:06.133869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:03:06.133869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:03:06.133869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: 46b3aa99a5e84ef2a8df193628feb0d6 Aug 24 09:03:06.133869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-TestVolumeBootPattern-9404766-project Aug 24 09:03:06.133869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:03:06.133869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. Aug 24 09:03:06.133869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '2dff703e-fd9a-4783-9b0d-98337571e993'} Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:03:06.135025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. Aug 24 09:03:06.136314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:03:06.137422 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5b47f5b3-88b2-471c-a591-197a5959fd1b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Returning 404 to user: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:03:06.137422 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5b47f5b3-88b2-471c-a591-197a5959fd1b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 404 len: 111 microversion: 2.1 time: 0.032385 Aug 24 09:03:06.137422 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 442/885] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:06 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:03:06.238205 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1837905686", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1984818663", "security_groups": [{"name": "tempest-secgroup-smoke-1880210330"}], "block_device_mapping_v2": [{"uuid": "61c8fb8f-12ef-4d06-8999-34980ac06af8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8db512de-7d14-42f9-8a8f-b89724242fee"}]}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:06.387435 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] validate_networks() for [('8db512de-7d14-42f9-8a8f-b89724242fee', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:03:06.887003 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-1defeec9-5dac-4d8e-89a8-5fe70f25e406 req-cdf57fa1-5697-4675-8ab3-c9fa5b9db0df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e05dfbb2-5e47-4ddf-897d-10e19be499ca", "tag": "ca6a6a1a-7c92-4d61-9b26-4ffea23e5485"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:06.898669 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1defeec9-5dac-4d8e-89a8-5fe70f25e406 req-cdf57fa1-5697-4675-8ab3-c9fa5b9db0df service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:06.899268 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1defeec9-5dac-4d8e-89a8-5fe70f25e406 req-cdf57fa1-5697-4675-8ab3-c9fa5b9db0df service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:06.899798 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-1defeec9-5dac-4d8e-89a8-5fe70f25e406 req-cdf57fa1-5697-4675-8ab3-c9fa5b9db0df service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:06.912253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-1defeec9-5dac-4d8e-89a8-5fe70f25e406 req-cdf57fa1-5697-4675-8ab3-c9fa5b9db0df service nova] Creating event network-changed:ca6a6a1a-7c92-4d61-9b26-4ffea23e5485 for instance e05dfbb2-5e47-4ddf-897d-10e19be499ca on hv-cinder-83538 Aug 24 09:03:06.917580 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-1defeec9-5dac-4d8e-89a8-5fe70f25e406 req-cdf57fa1-5697-4675-8ab3-c9fa5b9db0df service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034442 Aug 24 09:03:06.918563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 443/886] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:07.032765 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:03:07.033194 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:03:07.033671 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:03:07.034080 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:03:07.034502 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:03:07.043936 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:07.044445 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:07.045052 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:07.046586 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:07.047187 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:07.047613 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:07.065958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Getting quotas for project 080318594f144fa3852577bc02ee5357. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:03:07.070134 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Getting quotas for user 46b3aa99a5e84ef2a8df193628feb0d6 and project 080318594f144fa3852577bc02ee5357. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:03:07.135592 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:03:07.137894 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61c8fb8f-12ef-4d06-8999-34980ac06af8',volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:03:07.298836 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4046ce33-a9fd-4de7-9027-f9d43dccf3aa tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.064878 Aug 24 09:03:07.299515 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 444/887] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 09:03:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:03:07.310989 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-11beb51e-8c81-4b43-b1d9-6602ceb26b2e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:07.312048 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-11beb51e-8c81-4b43-b1d9-6602ceb26b2e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:07.389154 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-11beb51e-8c81-4b43-b1d9-6602ceb26b2e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:07.399574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-11beb51e-8c81-4b43-b1d9-6602ceb26b2e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1095 microversion: 2.1 time: 0.092729 Aug 24 09:03:07.401443 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 444/888] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:07 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1095 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:08.422030 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-91e36dca-9095-49e9-a4f2-52fe9531e85c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:08.423577 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-91e36dca-9095-49e9-a4f2-52fe9531e85c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:08.430101 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91e36dca-9095-49e9-a4f2-52fe9531e85c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:08.430590 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91e36dca-9095-49e9-a4f2-52fe9531e85c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:08.431023 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91e36dca-9095-49e9-a4f2-52fe9531e85c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:08.431724 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91e36dca-9095-49e9-a4f2-52fe9531e85c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:08.432201 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91e36dca-9095-49e9-a4f2-52fe9531e85c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:08.432621 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91e36dca-9095-49e9-a4f2-52fe9531e85c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:08.514274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-91e36dca-9095-49e9-a4f2-52fe9531e85c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:08.523118 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-91e36dca-9095-49e9-a4f2-52fe9531e85c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1211 microversion: 2.1 time: 0.105552 Aug 24 09:03:08.523684 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 445/889] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:08 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1211 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:09.546054 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ae499abc-b543-42a9-8cad-81b2a6d0f6f6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:09.547569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ae499abc-b543-42a9-8cad-81b2a6d0f6f6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:09.554926 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae499abc-b543-42a9-8cad-81b2a6d0f6f6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:09.555499 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae499abc-b543-42a9-8cad-81b2a6d0f6f6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:09.556034 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae499abc-b543-42a9-8cad-81b2a6d0f6f6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:09.556958 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae499abc-b543-42a9-8cad-81b2a6d0f6f6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:09.557518 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae499abc-b543-42a9-8cad-81b2a6d0f6f6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:09.558013 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae499abc-b543-42a9-8cad-81b2a6d0f6f6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:09.755350 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ae499abc-b543-42a9-8cad-81b2a6d0f6f6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:09.763564 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ae499abc-b543-42a9-8cad-81b2a6d0f6f6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1267 microversion: 2.1 time: 0.221554 Aug 24 09:03:09.764162 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 445/890] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:09 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:09.805164 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-66265799-625e-406b-8e6d-513b0c4a9d54 req-72e2358f-6ac1-4e22-9abe-d41735e63197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "442e038a-9739-4d4f-8e15-29230d79980e", "tag": "cde16a80-8a4a-4243-8358-2c2b63d48c1b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:09.818978 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-66265799-625e-406b-8e6d-513b0c4a9d54 req-72e2358f-6ac1-4e22-9abe-d41735e63197 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:09.819467 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-66265799-625e-406b-8e6d-513b0c4a9d54 req-72e2358f-6ac1-4e22-9abe-d41735e63197 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:09.819903 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-66265799-625e-406b-8e6d-513b0c4a9d54 req-72e2358f-6ac1-4e22-9abe-d41735e63197 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:09.835303 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-66265799-625e-406b-8e6d-513b0c4a9d54 req-72e2358f-6ac1-4e22-9abe-d41735e63197 service nova] Creating event network-changed:cde16a80-8a4a-4243-8358-2c2b63d48c1b for instance 442e038a-9739-4d4f-8e15-29230d79980e on hv-cinder-83538 Aug 24 09:03:09.841813 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-66265799-625e-406b-8e6d-513b0c4a9d54 req-72e2358f-6ac1-4e22-9abe-d41735e63197 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040339 Aug 24 09:03:09.842431 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 446/891] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:10.787069 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-23238215-d168-4cf5-b224-2b2a0490e52b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:10.787681 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-23238215-d168-4cf5-b224-2b2a0490e52b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:10.793829 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23238215-d168-4cf5-b224-2b2a0490e52b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:10.794318 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23238215-d168-4cf5-b224-2b2a0490e52b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:10.794758 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23238215-d168-4cf5-b224-2b2a0490e52b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:10.795451 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23238215-d168-4cf5-b224-2b2a0490e52b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:10.795979 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23238215-d168-4cf5-b224-2b2a0490e52b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:10.796992 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-23238215-d168-4cf5-b224-2b2a0490e52b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:10.927227 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-23238215-d168-4cf5-b224-2b2a0490e52b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:10.934934 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-23238215-d168-4cf5-b224-2b2a0490e52b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1267 microversion: 2.1 time: 0.151739 Aug 24 09:03:10.935500 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 446/892] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:10 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:11.955664 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4765b3e2-d326-486b-8868-3cff533b711d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:11.956394 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4765b3e2-d326-486b-8868-3cff533b711d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:11.963105 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4765b3e2-d326-486b-8868-3cff533b711d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:11.963585 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4765b3e2-d326-486b-8868-3cff533b711d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:11.964029 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4765b3e2-d326-486b-8868-3cff533b711d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:11.964761 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4765b3e2-d326-486b-8868-3cff533b711d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:11.965221 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4765b3e2-d326-486b-8868-3cff533b711d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:11.965652 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4765b3e2-d326-486b-8868-3cff533b711d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:12.107364 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-4765b3e2-d326-486b-8868-3cff533b711d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:12.115999 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4765b3e2-d326-486b-8868-3cff533b711d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1267 microversion: 2.1 time: 0.164806 Aug 24 09:03:12.116582 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 447/893] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:11 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:13.136550 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a2e66359-9409-4f24-9b10-56e06b2be66b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:13.137166 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a2e66359-9409-4f24-9b10-56e06b2be66b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:13.143399 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2e66359-9409-4f24-9b10-56e06b2be66b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:13.143877 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2e66359-9409-4f24-9b10-56e06b2be66b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:13.144335 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2e66359-9409-4f24-9b10-56e06b2be66b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:13.145160 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2e66359-9409-4f24-9b10-56e06b2be66b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:13.145678 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2e66359-9409-4f24-9b10-56e06b2be66b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:13.146101 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a2e66359-9409-4f24-9b10-56e06b2be66b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:13.278940 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a2e66359-9409-4f24-9b10-56e06b2be66b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:13.283081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:13.289039 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a2e66359-9409-4f24-9b10-56e06b2be66b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1267 microversion: 2.1 time: 0.156338 Aug 24 09:03:13.290665 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 447/894] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:13 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:14.310370 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b35bf0cc-82d5-4d06-acc9-501841a64df7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:14.310912 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b35bf0cc-82d5-4d06-acc9-501841a64df7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:14.317947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b35bf0cc-82d5-4d06-acc9-501841a64df7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:14.318432 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b35bf0cc-82d5-4d06-acc9-501841a64df7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:14.318870 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b35bf0cc-82d5-4d06-acc9-501841a64df7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:14.319559 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b35bf0cc-82d5-4d06-acc9-501841a64df7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:14.320014 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b35bf0cc-82d5-4d06-acc9-501841a64df7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:14.320466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b35bf0cc-82d5-4d06-acc9-501841a64df7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:14.449591 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b35bf0cc-82d5-4d06-acc9-501841a64df7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:14.458480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b35bf0cc-82d5-4d06-acc9-501841a64df7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1267 microversion: 2.1 time: 0.152001 Aug 24 09:03:14.459240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 448/895] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:14 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:15.478950 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-54ba3aba-0360-4ef2-9423-3b0cbd25ed9a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:15.479563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-54ba3aba-0360-4ef2-9423-3b0cbd25ed9a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:15.485767 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54ba3aba-0360-4ef2-9423-3b0cbd25ed9a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:15.486321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54ba3aba-0360-4ef2-9423-3b0cbd25ed9a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:15.486763 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54ba3aba-0360-4ef2-9423-3b0cbd25ed9a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:15.487464 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54ba3aba-0360-4ef2-9423-3b0cbd25ed9a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:15.487927 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54ba3aba-0360-4ef2-9423-3b0cbd25ed9a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:15.488397 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-54ba3aba-0360-4ef2-9423-3b0cbd25ed9a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:15.624357 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-54ba3aba-0360-4ef2-9423-3b0cbd25ed9a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:15.632571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-54ba3aba-0360-4ef2-9423-3b0cbd25ed9a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1267 microversion: 2.1 time: 0.157546 Aug 24 09:03:15.633145 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 448/896] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:15 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:16.654933 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c48b32da-33f9-4dab-a90c-575847ed4d0c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:16.655537 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c48b32da-33f9-4dab-a90c-575847ed4d0c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:16.662701 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48b32da-33f9-4dab-a90c-575847ed4d0c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:16.663194 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48b32da-33f9-4dab-a90c-575847ed4d0c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:16.663633 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48b32da-33f9-4dab-a90c-575847ed4d0c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:16.664367 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48b32da-33f9-4dab-a90c-575847ed4d0c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:16.664830 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48b32da-33f9-4dab-a90c-575847ed4d0c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:16.665260 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c48b32da-33f9-4dab-a90c-575847ed4d0c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:16.801022 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c48b32da-33f9-4dab-a90c-575847ed4d0c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:16.808524 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c48b32da-33f9-4dab-a90c-575847ed4d0c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1267 microversion: 2.1 time: 0.157541 Aug 24 09:03:16.809073 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 449/897] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:16 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:17.081399 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e479b7a2-a08b-486a-a4e1-3fb5fdc2b956 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:17.083569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e479b7a2-a08b-486a-a4e1-3fb5fdc2b956 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:17.089564 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e479b7a2-a08b-486a-a4e1-3fb5fdc2b956 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:17.090051 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e479b7a2-a08b-486a-a4e1-3fb5fdc2b956 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:17.090518 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e479b7a2-a08b-486a-a4e1-3fb5fdc2b956 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:17.091219 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e479b7a2-a08b-486a-a4e1-3fb5fdc2b956 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:17.091675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e479b7a2-a08b-486a-a4e1-3fb5fdc2b956 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:17.092122 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e479b7a2-a08b-486a-a4e1-3fb5fdc2b956 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:17.121708 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e479b7a2-a08b-486a-a4e1-3fb5fdc2b956 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044693 Aug 24 09:03:17.122307 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 449/898] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:03:17 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:03:17.184315 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-21f5bc0e-b176-4d5a-8348-d47e2440e065 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:17.184834 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-21f5bc0e-b176-4d5a-8348-d47e2440e065 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:17.186748 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:17.187396 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:17.193093 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f5bc0e-b176-4d5a-8348-d47e2440e065 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:17.193599 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f5bc0e-b176-4d5a-8348-d47e2440e065 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:17.194043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f5bc0e-b176-4d5a-8348-d47e2440e065 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:17.194804 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f5bc0e-b176-4d5a-8348-d47e2440e065 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:17.195212 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f5bc0e-b176-4d5a-8348-d47e2440e065 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:17.195645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-21f5bc0e-b176-4d5a-8348-d47e2440e065 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:17.222003 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-21f5bc0e-b176-4d5a-8348-d47e2440e065 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:03:17.298500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-21f5bc0e-b176-4d5a-8348-d47e2440e065 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 204 len: 0 microversion: 2.1 time: 0.117556 Aug 24 09:03:17.299100 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 450/899] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:03:17 2022] DELETE /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:03:17.307175 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-566af1c1-97b6-492d-b377-434a1c4fdac0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:17.307840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-566af1c1-97b6-492d-b377-434a1c4fdac0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:17.314395 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-566af1c1-97b6-492d-b377-434a1c4fdac0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:17.314888 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-566af1c1-97b6-492d-b377-434a1c4fdac0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:17.315329 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-566af1c1-97b6-492d-b377-434a1c4fdac0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:17.316020 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-566af1c1-97b6-492d-b377-434a1c4fdac0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:17.316507 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-566af1c1-97b6-492d-b377-434a1c4fdac0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:17.316930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-566af1c1-97b6-492d-b377-434a1c4fdac0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:17.399573 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:17.458027 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-566af1c1-97b6-492d-b377-434a1c4fdac0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:17.465782 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-566af1c1-97b6-492d-b377-434a1c4fdac0 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1675 microversion: 2.1 time: 0.162415 Aug 24 09:03:17.466337 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 450/900] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:17 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:17.830241 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c3d31917-8378-486b-9478-82b23a0f6f59 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:17.830940 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c3d31917-8378-486b-9478-82b23a0f6f59 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:17.837353 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3d31917-8378-486b-9478-82b23a0f6f59 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:17.837839 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3d31917-8378-486b-9478-82b23a0f6f59 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:17.838271 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3d31917-8378-486b-9478-82b23a0f6f59 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:17.838960 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3d31917-8378-486b-9478-82b23a0f6f59 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:17.839415 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3d31917-8378-486b-9478-82b23a0f6f59 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:17.839840 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c3d31917-8378-486b-9478-82b23a0f6f59 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:18.123435 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c3d31917-8378-486b-9478-82b23a0f6f59 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:18.131934 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c3d31917-8378-486b-9478-82b23a0f6f59 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1267 microversion: 2.1 time: 0.305979 Aug 24 09:03:18.132520 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 451/901] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:17 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1267 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:18.487466 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5c9fc57f-ac45-4206-9935-c0a4fd827bc4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:18.488075 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5c9fc57f-ac45-4206-9935-c0a4fd827bc4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:18.494059 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9fc57f-ac45-4206-9935-c0a4fd827bc4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:18.494544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9fc57f-ac45-4206-9935-c0a4fd827bc4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:18.494983 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9fc57f-ac45-4206-9935-c0a4fd827bc4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:18.495672 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9fc57f-ac45-4206-9935-c0a4fd827bc4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:18.496159 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9fc57f-ac45-4206-9935-c0a4fd827bc4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:18.496582 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c9fc57f-ac45-4206-9935-c0a4fd827bc4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:18.625927 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5c9fc57f-ac45-4206-9935-c0a4fd827bc4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:18.634334 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5c9fc57f-ac45-4206-9935-c0a4fd827bc4 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1675 microversion: 2.1 time: 0.151410 Aug 24 09:03:18.634892 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 451/902] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:18 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:19.153840 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-40005534-726b-4be6-b85a-c7a34929771d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:19.155263 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-40005534-726b-4be6-b85a-c7a34929771d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:19.162299 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40005534-726b-4be6-b85a-c7a34929771d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:19.162890 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40005534-726b-4be6-b85a-c7a34929771d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:19.163579 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40005534-726b-4be6-b85a-c7a34929771d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:19.164407 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40005534-726b-4be6-b85a-c7a34929771d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:19.164967 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40005534-726b-4be6-b85a-c7a34929771d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:19.165467 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-40005534-726b-4be6-b85a-c7a34929771d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:19.413207 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-40005534-726b-4be6-b85a-c7a34929771d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:19.422352 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-40005534-726b-4be6-b85a-c7a34929771d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1267 microversion: 2.1 time: 0.272873 Aug 24 09:03:19.422921 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 452/903] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:19 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:19.655779 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6fc57b72-89a9-41c5-b24c-529d28d4eedd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:19.656422 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6fc57b72-89a9-41c5-b24c-529d28d4eedd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:19.664470 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6fc57b72-89a9-41c5-b24c-529d28d4eedd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:19.665313 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6fc57b72-89a9-41c5-b24c-529d28d4eedd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:19.665796 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6fc57b72-89a9-41c5-b24c-529d28d4eedd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:19.666497 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6fc57b72-89a9-41c5-b24c-529d28d4eedd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:19.667007 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6fc57b72-89a9-41c5-b24c-529d28d4eedd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:19.667442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6fc57b72-89a9-41c5-b24c-529d28d4eedd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:19.741898 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6fc57b72-89a9-41c5-b24c-529d28d4eedd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:19.749763 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6fc57b72-89a9-41c5-b24c-529d28d4eedd tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1608 microversion: 2.1 time: 0.098304 Aug 24 09:03:19.750340 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 452/904] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:19 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1608 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:20.183893 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-8db002b6-18c1-4c33-b146-05f185886908 req-f560a861-4203-4b7c-a86b-cd4da5796a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2489f27e-e91b-4e45-8072-7b4226f576f8", "name": "network-vif-deleted", "tag": "f0b3f7af-883a-42f4-9c61-d5a909fd1e9a"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:20.198118 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8db002b6-18c1-4c33-b146-05f185886908 req-f560a861-4203-4b7c-a86b-cd4da5796a56 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:20.198898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8db002b6-18c1-4c33-b146-05f185886908 req-f560a861-4203-4b7c-a86b-cd4da5796a56 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:20.199329 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-8db002b6-18c1-4c33-b146-05f185886908 req-f560a861-4203-4b7c-a86b-cd4da5796a56 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:20.212297 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-8db002b6-18c1-4c33-b146-05f185886908 req-f560a861-4203-4b7c-a86b-cd4da5796a56 service nova] Creating event network-vif-deleted:f0b3f7af-883a-42f4-9c61-d5a909fd1e9a for instance 2489f27e-e91b-4e45-8072-7b4226f576f8 on hv-cinder-83538 Aug 24 09:03:20.218183 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-8db002b6-18c1-4c33-b146-05f185886908 req-f560a861-4203-4b7c-a86b-cd4da5796a56 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038019 Aug 24 09:03:20.218783 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 453/905] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:20.442876 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d1d9e8b3-91a1-4740-a8d3-774a9b1c2b69 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:20.443588 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d1d9e8b3-91a1-4740-a8d3-774a9b1c2b69 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:20.456387 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1d9e8b3-91a1-4740-a8d3-774a9b1c2b69 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:20.456387 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1d9e8b3-91a1-4740-a8d3-774a9b1c2b69 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:20.456387 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1d9e8b3-91a1-4740-a8d3-774a9b1c2b69 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:20.456387 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1d9e8b3-91a1-4740-a8d3-774a9b1c2b69 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:20.456697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1d9e8b3-91a1-4740-a8d3-774a9b1c2b69 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:20.456697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d1d9e8b3-91a1-4740-a8d3-774a9b1c2b69 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:20.466292 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-74f23e08-2ddd-4320-8627-2821e21aaa15 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:20.466909 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-74f23e08-2ddd-4320-8627-2821e21aaa15 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:20.474150 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74f23e08-2ddd-4320-8627-2821e21aaa15 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:20.474646 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74f23e08-2ddd-4320-8627-2821e21aaa15 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:20.475323 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74f23e08-2ddd-4320-8627-2821e21aaa15 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:20.476251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74f23e08-2ddd-4320-8627-2821e21aaa15 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:20.476712 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74f23e08-2ddd-4320-8627-2821e21aaa15 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:20.477139 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74f23e08-2ddd-4320-8627-2821e21aaa15 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:20.567748 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-74f23e08-2ddd-4320-8627-2821e21aaa15 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lazy-loading 'services' on Instance uuid e46c8263-fe1c-4e13-92a9-038085ee9ed8 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:03:20.598295 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d1d9e8b3-91a1-4740-a8d3-774a9b1c2b69 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:20.608002 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d1d9e8b3-91a1-4740-a8d3-774a9b1c2b69 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1267 microversion: 2.1 time: 0.169034 Aug 24 09:03:20.608612 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 453/906] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:20 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:20.649966 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-74f23e08-2ddd-4320-8627-2821e21aaa15 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-volume_attachments/e3e0a802-0323-4fb2-874e-f8597b29e42c" status: 202 len: 0 microversion: 2.1 time: 0.187758 Aug 24 09:03:20.650593 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 454/907] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 24 09:03:20 2022] DELETE /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-volume_attachments/e3e0a802-0323-4fb2-874e-f8597b29e42c => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 09:03:20.659396 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-463fb2aa-24ec-4f42-b20c-dccc3c2cef79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:20.661677 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-463fb2aa-24ec-4f42-b20c-dccc3c2cef79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:20.668381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-463fb2aa-24ec-4f42-b20c-dccc3c2cef79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:20.669859 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-463fb2aa-24ec-4f42-b20c-dccc3c2cef79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:20.670304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-463fb2aa-24ec-4f42-b20c-dccc3c2cef79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:20.671006 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-463fb2aa-24ec-4f42-b20c-dccc3c2cef79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:20.671467 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-463fb2aa-24ec-4f42-b20c-dccc3c2cef79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:20.671892 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-463fb2aa-24ec-4f42-b20c-dccc3c2cef79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:20.710184 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-463fb2aa-24ec-4f42-b20c-dccc3c2cef79 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054978 Aug 24 09:03:20.711188 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 454/908] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:03:20 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:03:20.775937 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-035188d6-b681-4dde-99eb-4467353d9575 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:20.777949 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-035188d6-b681-4dde-99eb-4467353d9575 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:20.789009 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-035188d6-b681-4dde-99eb-4467353d9575 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:20.793175 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-035188d6-b681-4dde-99eb-4467353d9575 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:20.795068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-035188d6-b681-4dde-99eb-4467353d9575 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:20.796277 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-035188d6-b681-4dde-99eb-4467353d9575 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:20.797350 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-035188d6-b681-4dde-99eb-4467353d9575 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:20.798774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-035188d6-b681-4dde-99eb-4467353d9575 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:20.821787 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:20.839718 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-035188d6-b681-4dde-99eb-4467353d9575 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:20.840331 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-035188d6-b681-4dde-99eb-4467353d9575 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:20.841037 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-035188d6-b681-4dde-99eb-4467353d9575 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:20.842306 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-035188d6-b681-4dde-99eb-4467353d9575 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lazy-loading 'fault' on Instance uuid 2489f27e-e91b-4e45-8072-7b4226f576f8 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:03:20.893395 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-035188d6-b681-4dde-99eb-4467353d9575 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:20.902547 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-035188d6-b681-4dde-99eb-4467353d9575 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 200 len: 1328 microversion: 2.1 time: 0.135125 Aug 24 09:03:20.903451 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 455/909] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:20 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 1328 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:20.969815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2831726a-e899-4b05-807c-10b594a242e9 req-f787eb86-70b5-49fb-b1cc-025174d3dd79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "442e038a-9739-4d4f-8e15-29230d79980e", "name": "network-vif-plugged", "status": "completed", "tag": "cde16a80-8a4a-4243-8358-2c2b63d48c1b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:20.981724 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2831726a-e899-4b05-807c-10b594a242e9 req-f787eb86-70b5-49fb-b1cc-025174d3dd79 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:20.982240 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2831726a-e899-4b05-807c-10b594a242e9 req-f787eb86-70b5-49fb-b1cc-025174d3dd79 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:20.982741 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2831726a-e899-4b05-807c-10b594a242e9 req-f787eb86-70b5-49fb-b1cc-025174d3dd79 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:20.994923 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2831726a-e899-4b05-807c-10b594a242e9 req-f787eb86-70b5-49fb-b1cc-025174d3dd79 service nova] Creating event network-vif-plugged:cde16a80-8a4a-4243-8358-2c2b63d48c1b for instance 442e038a-9739-4d4f-8e15-29230d79980e on hv-cinder-83538 Aug 24 09:03:21.000610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2831726a-e899-4b05-807c-10b594a242e9 req-f787eb86-70b5-49fb-b1cc-025174d3dd79 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034617 Aug 24 09:03:21.002357 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 455/910] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:21.629790 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-31257fd2-072a-4204-bd61-22ddb5aefdd7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:21.630387 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-31257fd2-072a-4204-bd61-22ddb5aefdd7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:21.637083 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31257fd2-072a-4204-bd61-22ddb5aefdd7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:21.637638 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31257fd2-072a-4204-bd61-22ddb5aefdd7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:21.638082 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31257fd2-072a-4204-bd61-22ddb5aefdd7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:21.638941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31257fd2-072a-4204-bd61-22ddb5aefdd7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:21.639405 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31257fd2-072a-4204-bd61-22ddb5aefdd7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:21.639865 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-31257fd2-072a-4204-bd61-22ddb5aefdd7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:21.724143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a66787a5-7457-4eed-963e-314e32cbb7f8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:21.726802 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a66787a5-7457-4eed-963e-314e32cbb7f8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:21.735014 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a66787a5-7457-4eed-963e-314e32cbb7f8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:21.735529 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a66787a5-7457-4eed-963e-314e32cbb7f8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:21.736489 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a66787a5-7457-4eed-963e-314e32cbb7f8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:21.737186 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a66787a5-7457-4eed-963e-314e32cbb7f8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:21.737791 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a66787a5-7457-4eed-963e-314e32cbb7f8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:21.738218 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a66787a5-7457-4eed-963e-314e32cbb7f8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:21.769207 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a66787a5-7457-4eed-963e-314e32cbb7f8 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049845 Aug 24 09:03:21.769773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 456/911] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:03:21 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:03:21.783390 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-31257fd2-072a-4204-bd61-22ddb5aefdd7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:21.791144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-31257fd2-072a-4204-bd61-22ddb5aefdd7 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1267 microversion: 2.1 time: 0.165876 Aug 24 09:03:21.791703 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 456/912] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:21 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:21.925413 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f00e8ae0-e1c7-4c94-b416-c1323330804c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:21.926030 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f00e8ae0-e1c7-4c94-b416-c1323330804c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:21.932066 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f00e8ae0-e1c7-4c94-b416-c1323330804c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:21.932588 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f00e8ae0-e1c7-4c94-b416-c1323330804c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:21.933028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f00e8ae0-e1c7-4c94-b416-c1323330804c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:21.933725 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f00e8ae0-e1c7-4c94-b416-c1323330804c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:21.934186 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f00e8ae0-e1c7-4c94-b416-c1323330804c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:21.934611 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f00e8ae0-e1c7-4c94-b416-c1323330804c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:21.948737 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-f00e8ae0-e1c7-4c94-b416-c1323330804c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] HTTP exception thrown: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f00e8ae0-e1c7-4c94-b416-c1323330804c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Request method failure captured: Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 HTTP/1.1 Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeeLb9AVLkFNdXtxTkq6l9eqZkrRWwz_AmC6cxAgei9IOBobTIVhN8gWeBLXOd_GqP9sgsTvEXru3c2GlG1bT4gPmGAa7yuDn9mUTomBxK4jh5RYpuKPxzUKsGuXdSj_tD6wDWW7BNZ01ilKkuTTNBzdxrbIj2uxb3ckDE1URCyiZig Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: bd6e1733fd9d4f5096c35e99dd56945b Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:03:21.950411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:03:21.952053 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:03:21.952053 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:03:21.952053 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: bd6e1733fd9d4f5096c35e99dd56945b Aug 24 09:03:21.952053 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:03:21.952053 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-AttachVolumeTestJSON-591255449-project Aug 24 09:03:21.952053 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:03:21.952053 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:03:21.952053 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: f0dc2dcc5327489c9ecc28a43ab7c0e2 Aug 24 09:03:21.952053 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeTestJSON-591255449-project Aug 24 09:03:21.952053 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:03:21.952053 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. Aug 24 09:03:21.952053 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '2489f27e-e91b-4e45-8072-7b4226f576f8'} Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:03:21.952952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. Aug 24 09:03:21.954296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:03:21.956131 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f00e8ae0-e1c7-4c94-b416-c1323330804c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Returning 404 to user: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:03:21.956131 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f00e8ae0-e1c7-4c94-b416-c1323330804c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 404 len: 111 microversion: 2.1 time: 0.030885 Aug 24 09:03:21.956131 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 457/913] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:21 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:03:21.961731 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0666b574-723b-4beb-a3ef-74482b7da793 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '.version_select at 0x7fb1454d5820>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:21.982412 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0666b574-723b-4beb-a3ef-74482b7da793 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1489975535" status: 202 len: 0 microversion: 2.1 time: 0.024649 Aug 24 09:03:21.982979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 457/914] 10.222.0.67 () {58 vars in 1221 bytes} [Wed Aug 24 09:03:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1489975535 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:03:22.620677 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-61162b5c-4796-4ad5-99fe-991408450f55 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Action: 'create', calling method: .version_select at 0x7fb140f73310>, body: {"keypair": {"name": "tempest-keypair-953611460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGYjEyOlxzh7SkAeDSkCKA7vbVEn0LPpJcmW2gvbczR4DzuorImPzNbL1BOb9B49ZmMwQ8rArx0u1wkvn/e9d/o8VfrQ0tOx7r1CfIWzAiY7Tpqkw87Q20VqqrgIN4oeQ=="}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:22.636010 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-61162b5c-4796-4ad5-99fe-991408450f55 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Getting quotas for project bd6e1733fd9d4f5096c35e99dd56945b. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:03:22.639828 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-61162b5c-4796-4ad5-99fe-991408450f55 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Getting quotas for user f0dc2dcc5327489c9ecc28a43ab7c0e2 and project bd6e1733fd9d4f5096c35e99dd56945b. Resources: {'key_pairs'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:03:22.663389 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-61162b5c-4796-4ad5-99fe-991408450f55 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046561 Aug 24 09:03:22.663987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 458/915] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 24 09:03:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:22.782970 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-88d9f546-73b2-4a3b-bf1d-e049909ac8f1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:22.785437 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-88d9f546-73b2-4a3b-bf1d-e049909ac8f1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:22.792597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88d9f546-73b2-4a3b-bf1d-e049909ac8f1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:22.793096 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88d9f546-73b2-4a3b-bf1d-e049909ac8f1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:22.793530 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88d9f546-73b2-4a3b-bf1d-e049909ac8f1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:22.794471 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88d9f546-73b2-4a3b-bf1d-e049909ac8f1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:22.794938 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88d9f546-73b2-4a3b-bf1d-e049909ac8f1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:22.795370 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-88d9f546-73b2-4a3b-bf1d-e049909ac8f1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:22.811394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dc26da18-a037-43a2-95f8-4ef5210b5670 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:22.812513 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dc26da18-a037-43a2-95f8-4ef5210b5670 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:22.819632 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc26da18-a037-43a2-95f8-4ef5210b5670 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:22.820154 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc26da18-a037-43a2-95f8-4ef5210b5670 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:22.820595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc26da18-a037-43a2-95f8-4ef5210b5670 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:22.824439 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc26da18-a037-43a2-95f8-4ef5210b5670 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:22.824439 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc26da18-a037-43a2-95f8-4ef5210b5670 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:22.824439 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc26da18-a037-43a2-95f8-4ef5210b5670 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:22.841509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-88d9f546-73b2-4a3b-bf1d-e049909ac8f1 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063941 Aug 24 09:03:22.842170 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 458/916] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:03:22 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:03:22.921907 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e97b436a-a243-4e5e-bad6-1c41a636aa67 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:22.922406 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e97b436a-a243-4e5e-bad6-1c41a636aa67 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:22.929567 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e97b436a-a243-4e5e-bad6-1c41a636aa67 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:22.930058 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e97b436a-a243-4e5e-bad6-1c41a636aa67 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:22.930496 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e97b436a-a243-4e5e-bad6-1c41a636aa67 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:22.931217 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e97b436a-a243-4e5e-bad6-1c41a636aa67 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:22.931658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e97b436a-a243-4e5e-bad6-1c41a636aa67 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:22.932302 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e97b436a-a243-4e5e-bad6-1c41a636aa67 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:22.965059 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e97b436a-a243-4e5e-bad6-1c41a636aa67 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:03:22.995528 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-dc26da18-a037-43a2-95f8-4ef5210b5670 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:23.007287 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dc26da18-a037-43a2-95f8-4ef5210b5670 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1267 microversion: 2.1 time: 0.199671 Aug 24 09:03:23.007878 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 459/917] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:22 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:23.053009 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e97b436a-a243-4e5e-bad6-1c41a636aa67 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 204 len: 0 microversion: 2.1 time: 0.135743 Aug 24 09:03:23.053878 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 459/918] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:03:22 2022] DELETE /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:03:23.064639 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c0f37e30-ef35-4651-8909-4c50e1cb08c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:23.065449 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c0f37e30-ef35-4651-8909-4c50e1cb08c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:23.072688 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0f37e30-ef35-4651-8909-4c50e1cb08c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:23.073374 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0f37e30-ef35-4651-8909-4c50e1cb08c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:23.073996 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0f37e30-ef35-4651-8909-4c50e1cb08c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:23.074973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0f37e30-ef35-4651-8909-4c50e1cb08c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:23.075719 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0f37e30-ef35-4651-8909-4c50e1cb08c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:23.076086 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0f37e30-ef35-4651-8909-4c50e1cb08c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:23.217976 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c0f37e30-ef35-4651-8909-4c50e1cb08c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:23.226600 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c0f37e30-ef35-4651-8909-4c50e1cb08c4 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1687 microversion: 2.1 time: 0.167435 Aug 24 09:03:23.227197 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 460/919] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:23 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:23.953975 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1424092719", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e3230a42-b6ee-441d-accc-432f33a6ab3a"}], "security_groups": [{"name": "tempest-securitygroup--306775811"}], "key_name": "tempest-keypair-953611460", "user_data": "}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:24.029061 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f063fa0f-f130-4dc8-8a19-1100c2d95406 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:24.029746 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f063fa0f-f130-4dc8-8a19-1100c2d95406 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:24.036616 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f063fa0f-f130-4dc8-8a19-1100c2d95406 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:24.037113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f063fa0f-f130-4dc8-8a19-1100c2d95406 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:24.037556 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f063fa0f-f130-4dc8-8a19-1100c2d95406 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:24.038267 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f063fa0f-f130-4dc8-8a19-1100c2d95406 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:24.038732 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f063fa0f-f130-4dc8-8a19-1100c2d95406 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:24.039161 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f063fa0f-f130-4dc8-8a19-1100c2d95406 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:24.059751 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] validate_networks() for [('e3230a42-b6ee-441d-accc-432f33a6ab3a', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:03:24.257340 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f063fa0f-f130-4dc8-8a19-1100c2d95406 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:24.265109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f063fa0f-f130-4dc8-8a19-1100c2d95406 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1454 microversion: 2.1 time: 0.239894 Aug 24 09:03:24.266041 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 461/920] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:24 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1454 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:24.270788 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2f1d05e2-9d89-4ab2-9512-d1385aed9c9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:24.271721 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2f1d05e2-9d89-4ab2-9512-d1385aed9c9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:24.277862 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f1d05e2-9d89-4ab2-9512-d1385aed9c9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:24.278343 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f1d05e2-9d89-4ab2-9512-d1385aed9c9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:24.278774 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f1d05e2-9d89-4ab2-9512-d1385aed9c9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:24.279460 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f1d05e2-9d89-4ab2-9512-d1385aed9c9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:24.279913 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f1d05e2-9d89-4ab2-9512-d1385aed9c9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:24.280355 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f1d05e2-9d89-4ab2-9512-d1385aed9c9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:24.490950 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2f1d05e2-9d89-4ab2-9512-d1385aed9c9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:24.499155 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2f1d05e2-9d89-4ab2-9512-d1385aed9c9e tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1687 microversion: 2.1 time: 0.232460 Aug 24 09:03:24.499750 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 462/921] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:24 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1687 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:24.505239 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9744b38a-4c81-473c-974d-e9aaf3f75720 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:24.506472 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9744b38a-4c81-473c-974d-e9aaf3f75720 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:24.512990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9744b38a-4c81-473c-974d-e9aaf3f75720 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:24.513483 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9744b38a-4c81-473c-974d-e9aaf3f75720 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:24.513926 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9744b38a-4c81-473c-974d-e9aaf3f75720 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:24.514627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9744b38a-4c81-473c-974d-e9aaf3f75720 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:24.515093 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9744b38a-4c81-473c-974d-e9aaf3f75720 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:24.515521 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9744b38a-4c81-473c-974d-e9aaf3f75720 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:24.621760 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:03:24.622181 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:03:24.622659 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:03:24.623070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:03:24.623481 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:03:24.633588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:24.634074 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:24.635169 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:24.635928 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:24.636424 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:24.636853 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:24.655610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Getting quotas for project bd6e1733fd9d4f5096c35e99dd56945b. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:03:24.658554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:24.661108 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Getting quotas for user f0dc2dcc5327489c9ecc28a43ab7c0e2 and project bd6e1733fd9d4f5096c35e99dd56945b. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:03:24.671034 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9744b38a-4c81-473c-974d-e9aaf3f75720 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:24.674777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:03:24.677203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:03:24.679921 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9744b38a-4c81-473c-974d-e9aaf3f75720 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1454 microversion: 2.1 time: 0.179120 Aug 24 09:03:24.680553 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 463/922] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:24 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1454 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:24.728070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-49445f51-b739-44ce-bce9-7ea380a596bb tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.778530 Aug 24 09:03:24.729075 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 460/923] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 09:03:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:03:24.743816 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c6d72455-48b6-4f0e-82fb-f1bff2842d54 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:24.744710 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c6d72455-48b6-4f0e-82fb-f1bff2842d54 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:24.816944 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c6d72455-48b6-4f0e-82fb-f1bff2842d54 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:24.824926 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c6d72455-48b6-4f0e-82fb-f1bff2842d54 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1237 microversion: 2.1 time: 0.087018 Aug 24 09:03:24.825902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 464/924] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:24 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:25.521930 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-442daaa2-ebd6-4771-bb3f-3d63ce364a78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:25.522702 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-442daaa2-ebd6-4771-bb3f-3d63ce364a78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:25.530764 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-442daaa2-ebd6-4771-bb3f-3d63ce364a78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:25.531279 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-442daaa2-ebd6-4771-bb3f-3d63ce364a78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:25.531705 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-442daaa2-ebd6-4771-bb3f-3d63ce364a78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:25.532442 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-442daaa2-ebd6-4771-bb3f-3d63ce364a78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:25.532996 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-442daaa2-ebd6-4771-bb3f-3d63ce364a78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:25.533426 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-442daaa2-ebd6-4771-bb3f-3d63ce364a78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:25.743865 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-442daaa2-ebd6-4771-bb3f-3d63ce364a78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:25.752161 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-442daaa2-ebd6-4771-bb3f-3d63ce364a78 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1687 microversion: 2.1 time: 0.235803 Aug 24 09:03:25.752736 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 461/925] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:25 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1687 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:25.847514 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-49ec882a-f58c-4500-9d0f-2c8c50e7ba7b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:25.848084 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-49ec882a-f58c-4500-9d0f-2c8c50e7ba7b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:25.854078 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49ec882a-f58c-4500-9d0f-2c8c50e7ba7b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:25.854566 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49ec882a-f58c-4500-9d0f-2c8c50e7ba7b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:25.855000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49ec882a-f58c-4500-9d0f-2c8c50e7ba7b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:25.855960 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49ec882a-f58c-4500-9d0f-2c8c50e7ba7b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:25.856537 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49ec882a-f58c-4500-9d0f-2c8c50e7ba7b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:25.857198 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-49ec882a-f58c-4500-9d0f-2c8c50e7ba7b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:25.958415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-49ec882a-f58c-4500-9d0f-2c8c50e7ba7b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:25.966096 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-49ec882a-f58c-4500-9d0f-2c8c50e7ba7b tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1241 microversion: 2.1 time: 0.123443 Aug 24 09:03:25.966781 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 465/926] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:25 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1241 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:26.451797 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-aece8d3f-4740-49b9-b316-5860888389ce req-854ad7de-102b-4419-b593-f966a8f70518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "442e038a-9739-4d4f-8e15-29230d79980e", "tag": "cde16a80-8a4a-4243-8358-2c2b63d48c1b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:26.462306 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-aece8d3f-4740-49b9-b316-5860888389ce req-854ad7de-102b-4419-b593-f966a8f70518 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:26.462787 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-aece8d3f-4740-49b9-b316-5860888389ce req-854ad7de-102b-4419-b593-f966a8f70518 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:26.463228 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-aece8d3f-4740-49b9-b316-5860888389ce req-854ad7de-102b-4419-b593-f966a8f70518 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:26.474446 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-aece8d3f-4740-49b9-b316-5860888389ce req-854ad7de-102b-4419-b593-f966a8f70518 service nova] Creating event network-changed:cde16a80-8a4a-4243-8358-2c2b63d48c1b for instance 442e038a-9739-4d4f-8e15-29230d79980e on hv-cinder-83538 Aug 24 09:03:26.479388 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-aece8d3f-4740-49b9-b316-5860888389ce req-854ad7de-102b-4419-b593-f966a8f70518 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031267 Aug 24 09:03:26.479979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 462/927] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:26.773506 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f896d56d-3482-4c1e-b7b8-35b98201d787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:26.774533 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f896d56d-3482-4c1e-b7b8-35b98201d787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:26.780452 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f896d56d-3482-4c1e-b7b8-35b98201d787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:26.780946 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f896d56d-3482-4c1e-b7b8-35b98201d787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:26.781379 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f896d56d-3482-4c1e-b7b8-35b98201d787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:26.782080 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f896d56d-3482-4c1e-b7b8-35b98201d787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:26.782540 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f896d56d-3482-4c1e-b7b8-35b98201d787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:26.783582 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f896d56d-3482-4c1e-b7b8-35b98201d787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:26.916449 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f896d56d-3482-4c1e-b7b8-35b98201d787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:26.924365 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f896d56d-3482-4c1e-b7b8-35b98201d787 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1687 microversion: 2.1 time: 0.154735 Aug 24 09:03:26.924937 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 466/928] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:26 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:26.988259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b72db41a-0d95-4a22-b5bf-d5c33410da51 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:26.989006 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b72db41a-0d95-4a22-b5bf-d5c33410da51 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:26.995274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b72db41a-0d95-4a22-b5bf-d5c33410da51 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:26.995768 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b72db41a-0d95-4a22-b5bf-d5c33410da51 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:26.996239 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b72db41a-0d95-4a22-b5bf-d5c33410da51 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:26.997140 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b72db41a-0d95-4a22-b5bf-d5c33410da51 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:26.998289 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b72db41a-0d95-4a22-b5bf-d5c33410da51 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:26.998727 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b72db41a-0d95-4a22-b5bf-d5c33410da51 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:27.062735 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b72db41a-0d95-4a22-b5bf-d5c33410da51 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:27.073174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b72db41a-0d95-4a22-b5bf-d5c33410da51 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1241 microversion: 2.1 time: 0.089283 Aug 24 09:03:27.074408 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 463/929] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:26 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:27.946084 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5c268c28-3e01-41c0-a880-13015cbb8417 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:27.947400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5c268c28-3e01-41c0-a880-13015cbb8417 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:27.952009 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:27.957400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c268c28-3e01-41c0-a880-13015cbb8417 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:27.957901 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c268c28-3e01-41c0-a880-13015cbb8417 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:27.958344 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c268c28-3e01-41c0-a880-13015cbb8417 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:27.959248 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c268c28-3e01-41c0-a880-13015cbb8417 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:27.959710 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c268c28-3e01-41c0-a880-13015cbb8417 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:27.960149 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c268c28-3e01-41c0-a880-13015cbb8417 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:28.094007 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-437e089a-dfff-4f31-bc7e-483f36a99031 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:28.096178 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-437e089a-dfff-4f31-bc7e-483f36a99031 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:28.103669 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-437e089a-dfff-4f31-bc7e-483f36a99031 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:28.104679 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-437e089a-dfff-4f31-bc7e-483f36a99031 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:28.105243 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-437e089a-dfff-4f31-bc7e-483f36a99031 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:28.106014 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-437e089a-dfff-4f31-bc7e-483f36a99031 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:28.106719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-437e089a-dfff-4f31-bc7e-483f36a99031 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:28.107144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-437e089a-dfff-4f31-bc7e-483f36a99031 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:28.514278 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-437e089a-dfff-4f31-bc7e-483f36a99031 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:28.523196 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-437e089a-dfff-4f31-bc7e-483f36a99031 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1295 microversion: 2.1 time: 0.433390 Aug 24 09:03:28.524009 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 464/930] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:28 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1295 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:28.721298 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5c268c28-3e01-41c0-a880-13015cbb8417 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:28.725077 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:28.732210 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5c268c28-3e01-41c0-a880-13015cbb8417 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1687 microversion: 2.1 time: 0.790542 Aug 24 09:03:28.732788 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 467/931] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:27 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1687 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:29.545266 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c1dd7950-4343-41a0-ace5-e5353be773a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:29.545878 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c1dd7950-4343-41a0-ace5-e5353be773a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:29.554432 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1dd7950-4343-41a0-ace5-e5353be773a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:29.555230 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1dd7950-4343-41a0-ace5-e5353be773a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:29.556473 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1dd7950-4343-41a0-ace5-e5353be773a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:29.557374 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1dd7950-4343-41a0-ace5-e5353be773a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:29.560389 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1dd7950-4343-41a0-ace5-e5353be773a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:29.561006 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c1dd7950-4343-41a0-ace5-e5353be773a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:29.650792 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c1dd7950-4343-41a0-ace5-e5353be773a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:29.660960 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c1dd7950-4343-41a0-ace5-e5353be773a1 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1295 microversion: 2.1 time: 0.119627 Aug 24 09:03:29.662320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 465/932] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:29 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1295 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:29.755946 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0685f3f0-7b72-4578-93f1-ce6f395089db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:29.757199 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0685f3f0-7b72-4578-93f1-ce6f395089db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:29.763927 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0685f3f0-7b72-4578-93f1-ce6f395089db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:29.764470 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0685f3f0-7b72-4578-93f1-ce6f395089db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:29.764902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0685f3f0-7b72-4578-93f1-ce6f395089db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:29.765600 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0685f3f0-7b72-4578-93f1-ce6f395089db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:29.766220 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0685f3f0-7b72-4578-93f1-ce6f395089db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:29.766798 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0685f3f0-7b72-4578-93f1-ce6f395089db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:29.870225 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0685f3f0-7b72-4578-93f1-ce6f395089db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:29.891958 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0685f3f0-7b72-4578-93f1-ce6f395089db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 200 len: 1619 microversion: 2.1 time: 0.142439 Aug 24 09:03:29.898645 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 468/933] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:29 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 1619 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:29.968453 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-33279682-d9af-44b6-a8c0-565dcf156aa2 req-6d6d2fa7-63fb-4229-9d8a-0cb5c50126b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e46c8263-fe1c-4e13-92a9-038085ee9ed8", "name": "network-vif-deleted", "tag": "1bd5c04d-326a-446b-b57a-525d40d706b9"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:29.983751 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-33279682-d9af-44b6-a8c0-565dcf156aa2 req-6d6d2fa7-63fb-4229-9d8a-0cb5c50126b2 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:29.989389 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-33279682-d9af-44b6-a8c0-565dcf156aa2 req-6d6d2fa7-63fb-4229-9d8a-0cb5c50126b2 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:29.990871 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-33279682-d9af-44b6-a8c0-565dcf156aa2 req-6d6d2fa7-63fb-4229-9d8a-0cb5c50126b2 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:30.021932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-33279682-d9af-44b6-a8c0-565dcf156aa2 req-6d6d2fa7-63fb-4229-9d8a-0cb5c50126b2 service nova] Creating event network-vif-deleted:1bd5c04d-326a-446b-b57a-525d40d706b9 for instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 on hv-cinder-83538 Aug 24 09:03:30.029013 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-33279682-d9af-44b6-a8c0-565dcf156aa2 req-6d6d2fa7-63fb-4229-9d8a-0cb5c50126b2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064339 Aug 24 09:03:30.030380 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 466/934] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:30.686544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21033fd5-67a9-48d8-92ac-159d4e25e885 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:30.688577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-21033fd5-67a9-48d8-92ac-159d4e25e885 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:30.696656 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21033fd5-67a9-48d8-92ac-159d4e25e885 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:30.697152 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21033fd5-67a9-48d8-92ac-159d4e25e885 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:30.697587 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21033fd5-67a9-48d8-92ac-159d4e25e885 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:30.698538 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21033fd5-67a9-48d8-92ac-159d4e25e885 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:30.698990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21033fd5-67a9-48d8-92ac-159d4e25e885 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:30.699576 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21033fd5-67a9-48d8-92ac-159d4e25e885 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:30.918171 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-307cf1b6-4137-4d14-b6c6-6b21040271cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:30.918889 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-307cf1b6-4137-4d14-b6c6-6b21040271cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: e46c8263-fe1c-4e13-92a9-038085ee9ed8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:30.919347 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-21033fd5-67a9-48d8-92ac-159d4e25e885 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:30.928523 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-307cf1b6-4137-4d14-b6c6-6b21040271cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:30.928937 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-21033fd5-67a9-48d8-92ac-159d4e25e885 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1362 microversion: 2.1 time: 0.249930 Aug 24 09:03:30.929053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-307cf1b6-4137-4d14-b6c6-6b21040271cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:30.929451 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-307cf1b6-4137-4d14-b6c6-6b21040271cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:30.929560 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 469/935] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:30 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:30.930170 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-307cf1b6-4137-4d14-b6c6-6b21040271cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:30.934607 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-307cf1b6-4137-4d14-b6c6-6b21040271cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:30.935255 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-307cf1b6-4137-4d14-b6c6-6b21040271cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:30.951411 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-307cf1b6-4137-4d14-b6c6-6b21040271cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] HTTP exception thrown: Instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 could not be found. Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-307cf1b6-4137-4d14-b6c6-6b21040271cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Request method failure captured: Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 HTTP/1.1 Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeQeb4NIRtpVDGaM1J2L0qDK5-xS8gcYMDBqdKvfZAFL7ABp5_RCKRstcrKGyfoShIdeqdE9FKD_wQVDFs9jrdbmlMmvZ597IzHE58w9lVMS0yxPRKMLsSi3X7uPLg36ZykjHg2NXN8EaoZqvJzoNTzXyNha6h0XTNQDcUxBGp-fxM Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: b5cb111df3ec4249a836518a598063a4 Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-363289357 Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:03:30.953259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:03:30.954628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b5cb111df3ec4249a836518a598063a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b5cb111df3ec4249a836518a598063a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b5cb111df3ec4249a836518a598063a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b5cb111df3ec4249a836518a598063a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:03:30.954628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-ServerRescueNegativeTestJSON-363289357 Aug 24 09:03:30.954628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: b5cb111df3ec4249a836518a598063a4 Aug 24 09:03:30.954628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-363289357 Aug 24 09:03:30.954628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-ServerRescueNegativeTestJSON-363289357-project Aug 24 09:03:30.954628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:03:30.954628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:03:30.954628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: 8ee5364270094596b64b08a8ac56f6ce Aug 24 09:03:30.954628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-ServerRescueNegativeTestJSON-363289357-project Aug 24 09:03:30.954628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:03:30.954628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 could not be found. Aug 24 09:03:30.954628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': 'e46c8263-fe1c-4e13-92a9-038085ee9ed8'} Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 could not be found. Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:03:30.955528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 could not be found. Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 could not be found. Aug 24 09:03:30.957305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:03:30.958393 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-307cf1b6-4137-4d14-b6c6-6b21040271cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Returning 404 to user: Instance e46c8263-fe1c-4e13-92a9-038085ee9ed8 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:03:30.958393 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-307cf1b6-4137-4d14-b6c6-6b21040271cf tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8" status: 404 len: 111 microversion: 2.1 time: 0.042362 Aug 24 09:03:30.958393 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 467/936] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:30 2022] GET /compute/v2.1/servers/e46c8263-fe1c-4e13-92a9-038085ee9ed8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:03:30.964356 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0b7a439f-6c14-46d5-89ae-049932c3a145 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '.version_select at 0x7fb140e10670>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:30.987325 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0b7a439f-6c14-46d5-89ae-049932c3a145 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-519484868" status: 202 len: 0 microversion: 2.1 time: 0.025842 Aug 24 09:03:30.988162 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 470/937] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 24 09:03:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-519484868 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:03:31.953956 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d8154fd3-6592-4b64-8d17-93162d2b5517 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:31.954501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d8154fd3-6592-4b64-8d17-93162d2b5517 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:31.961704 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8154fd3-6592-4b64-8d17-93162d2b5517 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:31.962195 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8154fd3-6592-4b64-8d17-93162d2b5517 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:31.962633 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8154fd3-6592-4b64-8d17-93162d2b5517 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:31.963331 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8154fd3-6592-4b64-8d17-93162d2b5517 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:31.963798 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8154fd3-6592-4b64-8d17-93162d2b5517 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:31.964248 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d8154fd3-6592-4b64-8d17-93162d2b5517 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:32.067194 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-45752905-c78e-48b0-98b0-6db0d91b1af0 req-25ff7016-5d52-4cac-af6c-c3fa4151a2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba55dcaa-1454-4bc2-bb93-45abb1e961e2", "tag": "18799bbd-7263-47b4-81aa-45798f3eea8b"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:32.078339 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-45752905-c78e-48b0-98b0-6db0d91b1af0 req-25ff7016-5d52-4cac-af6c-c3fa4151a2d5 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:32.078845 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-45752905-c78e-48b0-98b0-6db0d91b1af0 req-25ff7016-5d52-4cac-af6c-c3fa4151a2d5 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:32.079275 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-45752905-c78e-48b0-98b0-6db0d91b1af0 req-25ff7016-5d52-4cac-af6c-c3fa4151a2d5 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:32.092488 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-45752905-c78e-48b0-98b0-6db0d91b1af0 req-25ff7016-5d52-4cac-af6c-c3fa4151a2d5 service nova] Creating event network-changed:18799bbd-7263-47b4-81aa-45798f3eea8b for instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 on hv-cinder-83538 Aug 24 09:03:32.098428 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-45752905-c78e-48b0-98b0-6db0d91b1af0 req-25ff7016-5d52-4cac-af6c-c3fa4151a2d5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035559 Aug 24 09:03:32.099037 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 471/938] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:03:32.109009 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d8154fd3-6592-4b64-8d17-93162d2b5517 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:32.117053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d8154fd3-6592-4b64-8d17-93162d2b5517 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1362 microversion: 2.1 time: 0.166970 Aug 24 09:03:32.117900 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 468/939] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:31 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:33.139204 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8e5c363a-185f-472e-97f9-d250da809840 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:33.139897 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8e5c363a-185f-472e-97f9-d250da809840 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:33.146477 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e5c363a-185f-472e-97f9-d250da809840 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:33.146969 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e5c363a-185f-472e-97f9-d250da809840 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:33.147405 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e5c363a-185f-472e-97f9-d250da809840 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:33.148171 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e5c363a-185f-472e-97f9-d250da809840 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:33.148633 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e5c363a-185f-472e-97f9-d250da809840 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:33.149058 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e5c363a-185f-472e-97f9-d250da809840 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:33.286625 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8e5c363a-185f-472e-97f9-d250da809840 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:33.294372 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8e5c363a-185f-472e-97f9-d250da809840 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1362 microversion: 2.1 time: 0.159807 Aug 24 09:03:33.294948 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 472/940] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:33 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:34.028563 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c920ed52-b810-43e9-a66d-8f7dfb33bd9b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:34.029067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c920ed52-b810-43e9-a66d-8f7dfb33bd9b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:34.035404 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c920ed52-b810-43e9-a66d-8f7dfb33bd9b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:34.035898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c920ed52-b810-43e9-a66d-8f7dfb33bd9b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:34.036438 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c920ed52-b810-43e9-a66d-8f7dfb33bd9b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:34.037148 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c920ed52-b810-43e9-a66d-8f7dfb33bd9b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:34.037606 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c920ed52-b810-43e9-a66d-8f7dfb33bd9b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:34.038033 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c920ed52-b810-43e9-a66d-8f7dfb33bd9b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:34.063085 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c920ed52-b810-43e9-a66d-8f7dfb33bd9b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:03:34.142957 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c920ed52-b810-43e9-a66d-8f7dfb33bd9b tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "DELETE /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 204 len: 0 microversion: 2.1 time: 0.117935 Aug 24 09:03:34.146526 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 469/941] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:03:34 2022] DELETE /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:03:34.151862 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c0e9b2d4-f903-4fb6-bb86-89545531e493 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:34.152518 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c0e9b2d4-f903-4fb6-bb86-89545531e493 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:34.158956 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0e9b2d4-f903-4fb6-bb86-89545531e493 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:34.159550 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0e9b2d4-f903-4fb6-bb86-89545531e493 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:34.159894 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0e9b2d4-f903-4fb6-bb86-89545531e493 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:34.160632 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0e9b2d4-f903-4fb6-bb86-89545531e493 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:34.161092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0e9b2d4-f903-4fb6-bb86-89545531e493 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:34.161519 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c0e9b2d4-f903-4fb6-bb86-89545531e493 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:34.300026 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c0e9b2d4-f903-4fb6-bb86-89545531e493 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:34.307704 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c0e9b2d4-f903-4fb6-bb86-89545531e493 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1505 microversion: 2.1 time: 0.159977 Aug 24 09:03:34.308294 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 473/942] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:34 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:34.316285 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-379439ae-6902-4157-b117-64bce83de06c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:34.317021 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-379439ae-6902-4157-b117-64bce83de06c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:34.322998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-379439ae-6902-4157-b117-64bce83de06c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:34.323484 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-379439ae-6902-4157-b117-64bce83de06c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:34.323919 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-379439ae-6902-4157-b117-64bce83de06c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:34.324643 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-379439ae-6902-4157-b117-64bce83de06c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:34.325099 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-379439ae-6902-4157-b117-64bce83de06c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:34.325524 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-379439ae-6902-4157-b117-64bce83de06c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:34.454896 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-379439ae-6902-4157-b117-64bce83de06c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:34.462924 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-379439ae-6902-4157-b117-64bce83de06c tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1362 microversion: 2.1 time: 0.151559 Aug 24 09:03:34.463494 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 470/943] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:34 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:35.330749 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-25db6bf9-4ef1-44f1-b261-2563fdc0ec8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:35.331490 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-25db6bf9-4ef1-44f1-b261-2563fdc0ec8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:35.333933 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:35.340009 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25db6bf9-4ef1-44f1-b261-2563fdc0ec8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:35.340578 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25db6bf9-4ef1-44f1-b261-2563fdc0ec8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:35.341017 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25db6bf9-4ef1-44f1-b261-2563fdc0ec8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:35.341760 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25db6bf9-4ef1-44f1-b261-2563fdc0ec8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:35.342209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25db6bf9-4ef1-44f1-b261-2563fdc0ec8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:35.343144 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25db6bf9-4ef1-44f1-b261-2563fdc0ec8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:35.484082 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-aa0fe4e5-a444-4e78-8a85-7bc154dcb29e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:35.484824 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-aa0fe4e5-a444-4e78-8a85-7bc154dcb29e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:35.486918 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:35.487762 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:35.494184 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa0fe4e5-a444-4e78-8a85-7bc154dcb29e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:35.494677 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa0fe4e5-a444-4e78-8a85-7bc154dcb29e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:35.495116 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa0fe4e5-a444-4e78-8a85-7bc154dcb29e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:35.495823 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa0fe4e5-a444-4e78-8a85-7bc154dcb29e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:35.496307 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa0fe4e5-a444-4e78-8a85-7bc154dcb29e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:35.496737 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa0fe4e5-a444-4e78-8a85-7bc154dcb29e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:35.554977 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-25db6bf9-4ef1-44f1-b261-2563fdc0ec8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:35.562992 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-25db6bf9-4ef1-44f1-b261-2563fdc0ec8d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 200 len: 1505 microversion: 2.1 time: 0.237168 Aug 24 09:03:35.563569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 474/944] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:35 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 1505 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:35.743926 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-aa0fe4e5-a444-4e78-8a85-7bc154dcb29e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:35.751735 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-aa0fe4e5-a444-4e78-8a85-7bc154dcb29e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1362 microversion: 2.1 time: 0.271445 Aug 24 09:03:35.753628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 471/945] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:35 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:35.773636 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-0a7ddba1-d7f6-45b4-a122-73e706d43908 req-bf063fff-003a-4ec2-8974-9e9506b591ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa211fc0-831d-4d6f-863e-b44a4c49f382", "name": "network-vif-deleted", "tag": "80cea5be-668b-4485-bc47-616ebf607678"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:35.784077 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0a7ddba1-d7f6-45b4-a122-73e706d43908 req-bf063fff-003a-4ec2-8974-9e9506b591ef service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:35.784682 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0a7ddba1-d7f6-45b4-a122-73e706d43908 req-bf063fff-003a-4ec2-8974-9e9506b591ef service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:35.785122 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0a7ddba1-d7f6-45b4-a122-73e706d43908 req-bf063fff-003a-4ec2-8974-9e9506b591ef service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:35.796723 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-0a7ddba1-d7f6-45b4-a122-73e706d43908 req-bf063fff-003a-4ec2-8974-9e9506b591ef service nova] Creating event network-vif-deleted:80cea5be-668b-4485-bc47-616ebf607678 for instance aa211fc0-831d-4d6f-863e-b44a4c49f382 on hv-cinder-83538 Aug 24 09:03:35.801973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-0a7ddba1-d7f6-45b4-a122-73e706d43908 req-bf063fff-003a-4ec2-8974-9e9506b591ef service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032744 Aug 24 09:03:35.802615 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 475/946] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:36.584412 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-05bb494f-0099-4ad9-8506-269afd1051db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:36.585021 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-05bb494f-0099-4ad9-8506-269afd1051db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: aa211fc0-831d-4d6f-863e-b44a4c49f382] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:36.591452 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05bb494f-0099-4ad9-8506-269afd1051db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:36.591938 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05bb494f-0099-4ad9-8506-269afd1051db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:36.592416 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05bb494f-0099-4ad9-8506-269afd1051db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:36.593114 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05bb494f-0099-4ad9-8506-269afd1051db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:36.593573 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05bb494f-0099-4ad9-8506-269afd1051db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:36.593999 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-05bb494f-0099-4ad9-8506-269afd1051db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:36.598087 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:36.609206 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-05bb494f-0099-4ad9-8506-269afd1051db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] HTTP exception thrown: Instance aa211fc0-831d-4d6f-863e-b44a4c49f382 could not be found. Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-05bb494f-0099-4ad9-8506-269afd1051db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Request method failure captured: Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 HTTP/1.1 Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeQeb4NIRtpVDGaM1J2L0qDK5-xS8gcYMDBqdKvfZAFL7ABp5_RCKRstcrKGyfoShIdeqdE9FKD_wQVDFs9jrdbmlMmvZ597IzHE58w9lVMS0yxPRKMLsSi3X7uPLg36ZykjHg2NXN8EaoZqvJzoNTzXyNha6h0XTNQDcUxBGp-fxM Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: b5cb111df3ec4249a836518a598063a4 Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-363289357 Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:03:36.611017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:03:36.613251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b5cb111df3ec4249a836518a598063a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b5cb111df3ec4249a836518a598063a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b5cb111df3ec4249a836518a598063a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b5cb111df3ec4249a836518a598063a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:03:36.613251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-ServerRescueNegativeTestJSON-363289357 Aug 24 09:03:36.613251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: b5cb111df3ec4249a836518a598063a4 Aug 24 09:03:36.613251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-363289357 Aug 24 09:03:36.613251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-ServerRescueNegativeTestJSON-363289357-project Aug 24 09:03:36.613251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:03:36.613251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:03:36.613251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: 8ee5364270094596b64b08a8ac56f6ce Aug 24 09:03:36.613251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-ServerRescueNegativeTestJSON-363289357-project Aug 24 09:03:36.613251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:03:36.613251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance aa211fc0-831d-4d6f-863e-b44a4c49f382 could not be found. Aug 24 09:03:36.613251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': 'aa211fc0-831d-4d6f-863e-b44a4c49f382'} Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa211fc0-831d-4d6f-863e-b44a4c49f382 could not be found. Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:03:36.614898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa211fc0-831d-4d6f-863e-b44a4c49f382 could not be found. Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa211fc0-831d-4d6f-863e-b44a4c49f382 could not be found. Aug 24 09:03:36.616986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:03:36.618352 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-05bb494f-0099-4ad9-8506-269afd1051db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Returning 404 to user: Instance aa211fc0-831d-4d6f-863e-b44a4c49f382 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:03:36.618352 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-05bb494f-0099-4ad9-8506-269afd1051db tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382" status: 404 len: 111 microversion: 2.1 time: 0.032801 Aug 24 09:03:36.618352 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 472/947] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:36 2022] GET /compute/v2.1/servers/aa211fc0-831d-4d6f-863e-b44a4c49f382 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:03:36.623558 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b998477e-d852-4fcc-9f53-bebdc10fdf9d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:36.624404 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b998477e-d852-4fcc-9f53-bebdc10fdf9d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:36.630848 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b998477e-d852-4fcc-9f53-bebdc10fdf9d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:36.631329 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b998477e-d852-4fcc-9f53-bebdc10fdf9d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:36.631764 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b998477e-d852-4fcc-9f53-bebdc10fdf9d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:36.633007 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b998477e-d852-4fcc-9f53-bebdc10fdf9d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:36.633463 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b998477e-d852-4fcc-9f53-bebdc10fdf9d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:36.633882 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b998477e-d852-4fcc-9f53-bebdc10fdf9d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:36.658787 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b998477e-d852-4fcc-9f53-bebdc10fdf9d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:03:36.734948 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b998477e-d852-4fcc-9f53-bebdc10fdf9d tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 204 len: 0 microversion: 2.1 time: 0.115954 Aug 24 09:03:36.735657 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 476/948] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:03:36 2022] DELETE /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:03:36.744887 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1549a2ce-d8ab-4dd3-9159-45130981a4f0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:36.745069 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1549a2ce-d8ab-4dd3-9159-45130981a4f0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:36.752422 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1549a2ce-d8ab-4dd3-9159-45130981a4f0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:36.752917 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1549a2ce-d8ab-4dd3-9159-45130981a4f0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:36.753356 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1549a2ce-d8ab-4dd3-9159-45130981a4f0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:36.754061 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1549a2ce-d8ab-4dd3-9159-45130981a4f0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:36.754522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1549a2ce-d8ab-4dd3-9159-45130981a4f0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:36.754952 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1549a2ce-d8ab-4dd3-9159-45130981a4f0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:36.775642 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1e19d15a-6756-4911-84a6-9b43215e9203 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:36.776408 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1e19d15a-6756-4911-84a6-9b43215e9203 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:36.782538 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e19d15a-6756-4911-84a6-9b43215e9203 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:36.783032 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e19d15a-6756-4911-84a6-9b43215e9203 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:36.784032 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e19d15a-6756-4911-84a6-9b43215e9203 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:36.785739 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e19d15a-6756-4911-84a6-9b43215e9203 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:36.785739 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e19d15a-6756-4911-84a6-9b43215e9203 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:36.785739 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e19d15a-6756-4911-84a6-9b43215e9203 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:36.980158 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1549a2ce-d8ab-4dd3-9159-45130981a4f0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:36.987529 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e19d15a-6756-4911-84a6-9b43215e9203 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:36.992450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1549a2ce-d8ab-4dd3-9159-45130981a4f0 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.251768 Aug 24 09:03:37.004124 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 473/949] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:36 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:37.004124 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-9600fc58-bbe7-47c7-95c0-b4f02f940529 req-9f8de912-dada-4fbe-be61-5c0e8b31e176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba55dcaa-1454-4bc2-bb93-45abb1e961e2", "name": "network-vif-plugged", "status": "completed", "tag": "18799bbd-7263-47b4-81aa-45798f3eea8b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:37.007744 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1e19d15a-6756-4911-84a6-9b43215e9203 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1362 microversion: 2.1 time: 0.236304 Aug 24 09:03:37.007908 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9600fc58-bbe7-47c7-95c0-b4f02f940529 req-9f8de912-dada-4fbe-be61-5c0e8b31e176 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:37.008376 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9600fc58-bbe7-47c7-95c0-b4f02f940529 req-9f8de912-dada-4fbe-be61-5c0e8b31e176 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:37.009079 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-9600fc58-bbe7-47c7-95c0-b4f02f940529 req-9f8de912-dada-4fbe-be61-5c0e8b31e176 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:37.009217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 477/950] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:36 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:37.020702 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-9600fc58-bbe7-47c7-95c0-b4f02f940529 req-9f8de912-dada-4fbe-be61-5c0e8b31e176 service nova] Creating event network-vif-plugged:18799bbd-7263-47b4-81aa-45798f3eea8b for instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 on hv-cinder-83538 Aug 24 09:03:37.025869 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-9600fc58-bbe7-47c7-95c0-b4f02f940529 req-9f8de912-dada-4fbe-be61-5c0e8b31e176 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031137 Aug 24 09:03:37.026534 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 474/951] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:38.013906 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-332651c5-fce3-413a-850c-396125580abc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:38.014525 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-332651c5-fce3-413a-850c-396125580abc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:38.021142 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-332651c5-fce3-413a-850c-396125580abc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:38.021631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-332651c5-fce3-413a-850c-396125580abc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:38.022073 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-332651c5-fce3-413a-850c-396125580abc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:38.022762 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-332651c5-fce3-413a-850c-396125580abc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:38.023255 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-332651c5-fce3-413a-850c-396125580abc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:38.023682 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-332651c5-fce3-413a-850c-396125580abc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:38.031115 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-aa4446b1-7cd5-440a-b136-6996980b55e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:38.031823 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-aa4446b1-7cd5-440a-b136-6996980b55e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:38.039129 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa4446b1-7cd5-440a-b136-6996980b55e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:38.039631 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa4446b1-7cd5-440a-b136-6996980b55e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:38.040076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa4446b1-7cd5-440a-b136-6996980b55e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:38.040835 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa4446b1-7cd5-440a-b136-6996980b55e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:38.041711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa4446b1-7cd5-440a-b136-6996980b55e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:38.041711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-aa4446b1-7cd5-440a-b136-6996980b55e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:38.225408 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-332651c5-fce3-413a-850c-396125580abc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:38.233439 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-332651c5-fce3-413a-850c-396125580abc tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.223397 Aug 24 09:03:38.234019 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 478/952] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:38 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:38.237278 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-aa4446b1-7cd5-440a-b136-6996980b55e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:38.245207 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-aa4446b1-7cd5-440a-b136-6996980b55e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1362 microversion: 2.1 time: 0.218964 Aug 24 09:03:38.245761 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 475/953] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:38 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:39.255319 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2844ff79-3a00-476b-a5c0-8972bcc02bf2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:39.255932 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2844ff79-3a00-476b-a5c0-8972bcc02bf2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:39.262111 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2844ff79-3a00-476b-a5c0-8972bcc02bf2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:39.262598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2844ff79-3a00-476b-a5c0-8972bcc02bf2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:39.263063 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2844ff79-3a00-476b-a5c0-8972bcc02bf2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:39.263761 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2844ff79-3a00-476b-a5c0-8972bcc02bf2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:39.264245 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2844ff79-3a00-476b-a5c0-8972bcc02bf2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:39.264671 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2844ff79-3a00-476b-a5c0-8972bcc02bf2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:39.265628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-337ae61d-5dce-4ed9-bcf4-c9217e860911 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:39.266237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-337ae61d-5dce-4ed9-bcf4-c9217e860911 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:39.273338 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337ae61d-5dce-4ed9-bcf4-c9217e860911 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:39.273821 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337ae61d-5dce-4ed9-bcf4-c9217e860911 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:39.274254 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337ae61d-5dce-4ed9-bcf4-c9217e860911 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:39.275198 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337ae61d-5dce-4ed9-bcf4-c9217e860911 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:39.275652 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337ae61d-5dce-4ed9-bcf4-c9217e860911 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:39.276069 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-337ae61d-5dce-4ed9-bcf4-c9217e860911 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:39.509168 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2844ff79-3a00-476b-a5c0-8972bcc02bf2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:39.512173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-337ae61d-5dce-4ed9-bcf4-c9217e860911 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:39.518897 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2844ff79-3a00-476b-a5c0-8972bcc02bf2 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.267151 Aug 24 09:03:39.519514 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 479/954] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:39 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:39.520972 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-337ae61d-5dce-4ed9-bcf4-c9217e860911 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1362 microversion: 2.1 time: 0.259184 Aug 24 09:03:39.521541 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 476/955] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:39 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:03:40.542238 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e68c48d0-d5db-4b0b-8923-08e6c4554376 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:40.542942 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e68c48d0-d5db-4b0b-8923-08e6c4554376 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:40.548148 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6a846303-26fa-4c47-967d-986badc05bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:40.550095 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6a846303-26fa-4c47-967d-986badc05bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:40.551465 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e68c48d0-d5db-4b0b-8923-08e6c4554376 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:40.551966 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e68c48d0-d5db-4b0b-8923-08e6c4554376 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:40.552436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e68c48d0-d5db-4b0b-8923-08e6c4554376 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:40.553203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e68c48d0-d5db-4b0b-8923-08e6c4554376 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:40.553901 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e68c48d0-d5db-4b0b-8923-08e6c4554376 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:40.554485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e68c48d0-d5db-4b0b-8923-08e6c4554376 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:40.557978 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a846303-26fa-4c47-967d-986badc05bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:40.558467 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a846303-26fa-4c47-967d-986badc05bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:40.558900 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a846303-26fa-4c47-967d-986badc05bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:40.559826 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a846303-26fa-4c47-967d-986badc05bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:40.560323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a846303-26fa-4c47-967d-986badc05bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:40.560752 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6a846303-26fa-4c47-967d-986badc05bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:40.850856 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6a846303-26fa-4c47-967d-986badc05bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee5364270094596b64b08a8ac56f6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5cb111df3ec4249a836518a598063a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:40.854302 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e68c48d0-d5db-4b0b-8923-08e6c4554376 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:40.860256 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6a846303-26fa-4c47-967d-986badc05bfd tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 200 len: 1521 microversion: 2.1 time: 0.323820 Aug 24 09:03:40.862321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 480/956] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:40 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:40.863500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e68c48d0-d5db-4b0b-8923-08e6c4554376 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1548 microversion: 2.1 time: 0.324874 Aug 24 09:03:40.868408 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-2b70b1ec-b41a-400a-9e50-c9b7e2de227c req-78138972-afec-4973-9e8b-b19636582404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6cadaae-8d3b-485a-87a8-cdf9b320b2b8", "name": "network-vif-deleted", "tag": "997e8c94-fb8c-46c5-848a-11eb858266eb"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:40.879146 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2b70b1ec-b41a-400a-9e50-c9b7e2de227c req-78138972-afec-4973-9e8b-b19636582404 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:40.879704 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2b70b1ec-b41a-400a-9e50-c9b7e2de227c req-78138972-afec-4973-9e8b-b19636582404 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:40.880347 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-2b70b1ec-b41a-400a-9e50-c9b7e2de227c req-78138972-afec-4973-9e8b-b19636582404 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:40.880528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 477/957] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:40 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1548 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:03:40.885450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-501d7dc5-09ca-4dfe-8074-b7e4d0894207 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:40.885946 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-501d7dc5-09ca-4dfe-8074-b7e4d0894207 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:40.892209 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501d7dc5-09ca-4dfe-8074-b7e4d0894207 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:40.892813 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501d7dc5-09ca-4dfe-8074-b7e4d0894207 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:40.893260 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501d7dc5-09ca-4dfe-8074-b7e4d0894207 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:40.893409 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-2b70b1ec-b41a-400a-9e50-c9b7e2de227c req-78138972-afec-4973-9e8b-b19636582404 service nova] Creating event network-vif-deleted:997e8c94-fb8c-46c5-848a-11eb858266eb for instance d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 on hv-cinder-83538 Aug 24 09:03:40.894287 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501d7dc5-09ca-4dfe-8074-b7e4d0894207 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:40.894750 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501d7dc5-09ca-4dfe-8074-b7e4d0894207 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:40.895421 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-501d7dc5-09ca-4dfe-8074-b7e4d0894207 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:40.899211 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-2b70b1ec-b41a-400a-9e50-c9b7e2de227c req-78138972-afec-4973-9e8b-b19636582404 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035017 Aug 24 09:03:40.900062 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 481/958] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:41.006088 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-501d7dc5-09ca-4dfe-8074-b7e4d0894207 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124448 Aug 24 09:03:41.007453 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 478/959] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 24 09:03:40 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:41.883362 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1559f644-f371-475d-82f1-e3ba5f553c24 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:41.884065 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1559f644-f371-475d-82f1-e3ba5f553c24 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] [instance: d6cadaae-8d3b-485a-87a8-cdf9b320b2b8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:41.890637 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1559f644-f371-475d-82f1-e3ba5f553c24 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:41.891132 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1559f644-f371-475d-82f1-e3ba5f553c24 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:41.891573 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1559f644-f371-475d-82f1-e3ba5f553c24 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:41.892308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1559f644-f371-475d-82f1-e3ba5f553c24 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:41.894033 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1559f644-f371-475d-82f1-e3ba5f553c24 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:41.894349 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1559f644-f371-475d-82f1-e3ba5f553c24 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:41.910919 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-1559f644-f371-475d-82f1-e3ba5f553c24 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] HTTP exception thrown: Instance d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 could not be found. Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1559f644-f371-475d-82f1-e3ba5f553c24 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Request method failure captured: Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 HTTP/1.1 Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeeQeb4NIRtpVDGaM1J2L0qDK5-xS8gcYMDBqdKvfZAFL7ABp5_RCKRstcrKGyfoShIdeqdE9FKD_wQVDFs9jrdbmlMmvZ597IzHE58w9lVMS0yxPRKMLsSi3X7uPLg36ZykjHg2NXN8EaoZqvJzoNTzXyNha6h0XTNQDcUxBGp-fxM Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: b5cb111df3ec4249a836518a598063a4 Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-363289357 Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:03:41.912607 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:03:41.914304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b5cb111df3ec4249a836518a598063a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b5cb111df3ec4249a836518a598063a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b5cb111df3ec4249a836518a598063a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b5cb111df3ec4249a836518a598063a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:03:41.914304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-ServerRescueNegativeTestJSON-363289357 Aug 24 09:03:41.914304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: b5cb111df3ec4249a836518a598063a4 Aug 24 09:03:41.914304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-363289357 Aug 24 09:03:41.914304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-ServerRescueNegativeTestJSON-363289357-project Aug 24 09:03:41.914304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:03:41.914304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:03:41.914304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: 8ee5364270094596b64b08a8ac56f6ce Aug 24 09:03:41.914304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-ServerRescueNegativeTestJSON-363289357-project Aug 24 09:03:41.914304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:03:41.914304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 could not be found. Aug 24 09:03:41.914304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': 'd6cadaae-8d3b-485a-87a8-cdf9b320b2b8'} Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 could not be found. Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:03:41.915209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 could not be found. Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 could not be found. Aug 24 09:03:41.916627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:03:41.917914 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1559f644-f371-475d-82f1-e3ba5f553c24 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] Returning 404 to user: Instance d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:03:41.917914 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1559f644-f371-475d-82f1-e3ba5f553c24 tempest-ServerRescueNegativeTestJSON-363289357 tempest-ServerRescueNegativeTestJSON-363289357-project] 10.222.0.67 "GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8" status: 404 len: 111 microversion: 2.1 time: 0.034920 Aug 24 09:03:41.918058 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 482/960] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:41 2022] GET /compute/v2.1/servers/d6cadaae-8d3b-485a-87a8-cdf9b320b2b8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:03:42.915476 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-3a78e388-3ad0-4707-825d-9c6647d1f224 req-8d3bae3e-d460-4890-a436-bd919b23e16e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba55dcaa-1454-4bc2-bb93-45abb1e961e2", "tag": "18799bbd-7263-47b4-81aa-45798f3eea8b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:42.926001 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3a78e388-3ad0-4707-825d-9c6647d1f224 req-8d3bae3e-d460-4890-a436-bd919b23e16e service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:42.926499 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3a78e388-3ad0-4707-825d-9c6647d1f224 req-8d3bae3e-d460-4890-a436-bd919b23e16e service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:42.926928 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-3a78e388-3ad0-4707-825d-9c6647d1f224 req-8d3bae3e-d460-4890-a436-bd919b23e16e service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:42.938293 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-3a78e388-3ad0-4707-825d-9c6647d1f224 req-8d3bae3e-d460-4890-a436-bd919b23e16e service nova] Creating event network-changed:18799bbd-7263-47b4-81aa-45798f3eea8b for instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 on hv-cinder-83538 Aug 24 09:03:42.944080 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-3a78e388-3ad0-4707-825d-9c6647d1f224 req-8d3bae3e-d460-4890-a436-bd919b23e16e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032549 Aug 24 09:03:42.944972 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 479/961] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:03:58.907225 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-11784efa-b177-4b5d-ba0b-e65c83ec3c2a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:03:58.907816 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-11784efa-b177-4b5d-ba0b-e65c83ec3c2a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:58.911092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:58.911757 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:58.918309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11784efa-b177-4b5d-ba0b-e65c83ec3c2a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:58.918781 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11784efa-b177-4b5d-ba0b-e65c83ec3c2a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:58.919220 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11784efa-b177-4b5d-ba0b-e65c83ec3c2a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:58.919933 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11784efa-b177-4b5d-ba0b-e65c83ec3c2a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:58.920432 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11784efa-b177-4b5d-ba0b-e65c83ec3c2a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:58.920866 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11784efa-b177-4b5d-ba0b-e65c83ec3c2a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:58.945867 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-11784efa-b177-4b5d-ba0b-e65c83ec3c2a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lazy-loading 'flavor' on Instance uuid 8c4056ca-2520-4b9f-8d6f-818005b9a13e {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:03:59.024400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-11784efa-b177-4b5d-ba0b-e65c83ec3c2a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "POST /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e/action" status: 202 len: 0 microversion: 2.1 time: 0.120888 Aug 24 09:03:59.025527 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 483/962] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 24 09:03:58 2022] POST /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:03:59.046215 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5b76b190-8768-4655-9c1a-91e887ef0e47 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:03:59.046944 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5b76b190-8768-4655-9c1a-91e887ef0e47 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:03:59.049313 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:59.052030 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=32 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:59.058667 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b76b190-8768-4655-9c1a-91e887ef0e47 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:59.059170 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b76b190-8768-4655-9c1a-91e887ef0e47 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:59.059613 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b76b190-8768-4655-9c1a-91e887ef0e47 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:59.060363 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b76b190-8768-4655-9c1a-91e887ef0e47 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:03:59.060826 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b76b190-8768-4655-9c1a-91e887ef0e47 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:03:59.061438 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5b76b190-8768-4655-9c1a-91e887ef0e47 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:03:59.224974 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5b76b190-8768-4655-9c1a-91e887ef0e47 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:03:59.232898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5b76b190-8768-4655-9c1a-91e887ef0e47 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1566 microversion: 2.1 time: 0.201276 Aug 24 09:03:59.233464 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 480/963] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:03:59 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1566 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:00.256374 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b4cf6234-a0ce-4375-b20d-10882b9e0618 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:00.257072 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b4cf6234-a0ce-4375-b20d-10882b9e0618 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:00.263455 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4cf6234-a0ce-4375-b20d-10882b9e0618 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:00.263945 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4cf6234-a0ce-4375-b20d-10882b9e0618 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:00.264480 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4cf6234-a0ce-4375-b20d-10882b9e0618 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:00.265269 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4cf6234-a0ce-4375-b20d-10882b9e0618 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:00.265731 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4cf6234-a0ce-4375-b20d-10882b9e0618 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:00.266149 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b4cf6234-a0ce-4375-b20d-10882b9e0618 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:00.403940 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b4cf6234-a0ce-4375-b20d-10882b9e0618 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:00.412446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b4cf6234-a0ce-4375-b20d-10882b9e0618 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1566 microversion: 2.1 time: 0.161335 Aug 24 09:04:00.413141 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 484/964] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:00 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:01.434998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ffea557b-b568-4d43-bd3e-8704eab53ef1 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:01.435761 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ffea557b-b568-4d43-bd3e-8704eab53ef1 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:01.442620 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffea557b-b568-4d43-bd3e-8704eab53ef1 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:01.443117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffea557b-b568-4d43-bd3e-8704eab53ef1 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:01.443559 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffea557b-b568-4d43-bd3e-8704eab53ef1 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:01.444305 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffea557b-b568-4d43-bd3e-8704eab53ef1 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:01.444771 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffea557b-b568-4d43-bd3e-8704eab53ef1 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:01.445199 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ffea557b-b568-4d43-bd3e-8704eab53ef1 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:01.580441 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ffea557b-b568-4d43-bd3e-8704eab53ef1 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:01.588984 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ffea557b-b568-4d43-bd3e-8704eab53ef1 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1566 microversion: 2.1 time: 0.157926 Aug 24 09:04:01.593334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 481/965] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:01 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:02.611228 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-027cf389-db9c-4c58-99ef-4c81b5e6ac1a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:02.611805 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-027cf389-db9c-4c58-99ef-4c81b5e6ac1a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:02.618260 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-027cf389-db9c-4c58-99ef-4c81b5e6ac1a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:02.618743 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-027cf389-db9c-4c58-99ef-4c81b5e6ac1a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:02.619176 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-027cf389-db9c-4c58-99ef-4c81b5e6ac1a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:02.619865 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-027cf389-db9c-4c58-99ef-4c81b5e6ac1a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:02.620350 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-027cf389-db9c-4c58-99ef-4c81b5e6ac1a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:02.620775 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-027cf389-db9c-4c58-99ef-4c81b5e6ac1a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:02.763833 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-027cf389-db9c-4c58-99ef-4c81b5e6ac1a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:02.771681 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-027cf389-db9c-4c58-99ef-4c81b5e6ac1a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1566 microversion: 2.1 time: 0.164324 Aug 24 09:04:02.772273 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 485/966] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:02 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:03.792658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f3d9bf37-e1a6-4538-b2e9-9d6ebf183273 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:03.793273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f3d9bf37-e1a6-4538-b2e9-9d6ebf183273 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:03.799882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3d9bf37-e1a6-4538-b2e9-9d6ebf183273 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:03.800396 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3d9bf37-e1a6-4538-b2e9-9d6ebf183273 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:03.800842 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3d9bf37-e1a6-4538-b2e9-9d6ebf183273 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:03.801613 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3d9bf37-e1a6-4538-b2e9-9d6ebf183273 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:03.802075 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3d9bf37-e1a6-4538-b2e9-9d6ebf183273 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:03.802503 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f3d9bf37-e1a6-4538-b2e9-9d6ebf183273 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:03.941587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f3d9bf37-e1a6-4538-b2e9-9d6ebf183273 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:03.950085 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f3d9bf37-e1a6-4538-b2e9-9d6ebf183273 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1566 microversion: 2.1 time: 0.161335 Aug 24 09:04:03.950850 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 482/967] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:03 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:04.973664 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a8d4fec9-4bc8-4a14-ba1a-c0fb713538ff tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:04.974301 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a8d4fec9-4bc8-4a14-ba1a-c0fb713538ff tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:04.980543 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8d4fec9-4bc8-4a14-ba1a-c0fb713538ff tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:04.981020 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8d4fec9-4bc8-4a14-ba1a-c0fb713538ff tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:04.981510 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8d4fec9-4bc8-4a14-ba1a-c0fb713538ff tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:04.982221 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8d4fec9-4bc8-4a14-ba1a-c0fb713538ff tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:04.982687 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8d4fec9-4bc8-4a14-ba1a-c0fb713538ff tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:04.983115 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8d4fec9-4bc8-4a14-ba1a-c0fb713538ff tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:05.125638 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a8d4fec9-4bc8-4a14-ba1a-c0fb713538ff tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:05.134143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a8d4fec9-4bc8-4a14-ba1a-c0fb713538ff tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1566 microversion: 2.1 time: 0.165412 Aug 24 09:04:05.134753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 486/968] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:04 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:06.158454 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c4998831-c794-4feb-876a-45a2cf66425d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:06.159052 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c4998831-c794-4feb-876a-45a2cf66425d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:06.170003 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4998831-c794-4feb-876a-45a2cf66425d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:06.170511 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4998831-c794-4feb-876a-45a2cf66425d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:06.170963 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4998831-c794-4feb-876a-45a2cf66425d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:06.171804 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4998831-c794-4feb-876a-45a2cf66425d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:06.172222 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4998831-c794-4feb-876a-45a2cf66425d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:06.172716 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c4998831-c794-4feb-876a-45a2cf66425d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:06.322159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c4998831-c794-4feb-876a-45a2cf66425d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:06.330789 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c4998831-c794-4feb-876a-45a2cf66425d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1566 microversion: 2.1 time: 0.175616 Aug 24 09:04:06.331367 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 483/969] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:06 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:07.352499 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c994d8a3-06a5-44b9-9c60-dcdc1230307c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:07.353103 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c994d8a3-06a5-44b9-9c60-dcdc1230307c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:07.359009 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c994d8a3-06a5-44b9-9c60-dcdc1230307c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:07.359484 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c994d8a3-06a5-44b9-9c60-dcdc1230307c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:07.359920 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c994d8a3-06a5-44b9-9c60-dcdc1230307c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:07.360628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c994d8a3-06a5-44b9-9c60-dcdc1230307c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:07.361092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c994d8a3-06a5-44b9-9c60-dcdc1230307c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:07.361511 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c994d8a3-06a5-44b9-9c60-dcdc1230307c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:07.493117 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c994d8a3-06a5-44b9-9c60-dcdc1230307c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:07.500857 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c994d8a3-06a5-44b9-9c60-dcdc1230307c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1566 microversion: 2.1 time: 0.152391 Aug 24 09:04:07.501348 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 487/970] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:07 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:08.522865 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-87ec670d-4b8c-4595-95ae-3c805e80c756 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:08.523445 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-87ec670d-4b8c-4595-95ae-3c805e80c756 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:08.530161 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87ec670d-4b8c-4595-95ae-3c805e80c756 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:08.530692 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87ec670d-4b8c-4595-95ae-3c805e80c756 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:08.531119 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87ec670d-4b8c-4595-95ae-3c805e80c756 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:08.531803 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87ec670d-4b8c-4595-95ae-3c805e80c756 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:08.532308 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87ec670d-4b8c-4595-95ae-3c805e80c756 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:08.532730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-87ec670d-4b8c-4595-95ae-3c805e80c756 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:08.679819 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-87ec670d-4b8c-4595-95ae-3c805e80c756 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:08.687874 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-87ec670d-4b8c-4595-95ae-3c805e80c756 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1566 microversion: 2.1 time: 0.168975 Aug 24 09:04:08.688477 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 484/971] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:08 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:09.710309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b5d93391-682d-4927-8d99-c7a1f532b80e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:09.711065 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b5d93391-682d-4927-8d99-c7a1f532b80e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:09.717384 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d93391-682d-4927-8d99-c7a1f532b80e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:09.718144 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d93391-682d-4927-8d99-c7a1f532b80e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:09.718769 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d93391-682d-4927-8d99-c7a1f532b80e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:09.719477 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d93391-682d-4927-8d99-c7a1f532b80e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:09.719942 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d93391-682d-4927-8d99-c7a1f532b80e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:09.720486 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b5d93391-682d-4927-8d99-c7a1f532b80e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:09.852558 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b5d93391-682d-4927-8d99-c7a1f532b80e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:09.860236 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b5d93391-682d-4927-8d99-c7a1f532b80e tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1566 microversion: 2.1 time: 0.153955 Aug 24 09:04:09.860794 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 488/972] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:09 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:10.882903 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ca73e5a4-a1c6-4840-a6f0-839825bac384 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:10.883464 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ca73e5a4-a1c6-4840-a6f0-839825bac384 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:10.889987 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca73e5a4-a1c6-4840-a6f0-839825bac384 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:10.890469 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca73e5a4-a1c6-4840-a6f0-839825bac384 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:10.890905 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca73e5a4-a1c6-4840-a6f0-839825bac384 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:10.891587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca73e5a4-a1c6-4840-a6f0-839825bac384 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:10.892038 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca73e5a4-a1c6-4840-a6f0-839825bac384 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:10.892483 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ca73e5a4-a1c6-4840-a6f0-839825bac384 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:11.025286 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ca73e5a4-a1c6-4840-a6f0-839825bac384 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:11.033589 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ca73e5a4-a1c6-4840-a6f0-839825bac384 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1566 microversion: 2.1 time: 0.155675 Aug 24 09:04:11.034149 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 485/973] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:10 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:12.055405 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8e53883d-bced-410e-8e97-ff46cbdc0676 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:12.056177 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8e53883d-bced-410e-8e97-ff46cbdc0676 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:12.061920 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e53883d-bced-410e-8e97-ff46cbdc0676 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:12.062406 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e53883d-bced-410e-8e97-ff46cbdc0676 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:12.062828 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e53883d-bced-410e-8e97-ff46cbdc0676 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:12.063515 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e53883d-bced-410e-8e97-ff46cbdc0676 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:12.063962 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e53883d-bced-410e-8e97-ff46cbdc0676 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:12.064400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8e53883d-bced-410e-8e97-ff46cbdc0676 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:12.201279 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8e53883d-bced-410e-8e97-ff46cbdc0676 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:12.215350 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8e53883d-bced-410e-8e97-ff46cbdc0676 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1567 microversion: 2.1 time: 0.163294 Aug 24 09:04:12.215350 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 489/974] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:12 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:12.236222 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c939cce1-f109-4f16-99da-330ff52bf84c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:12.236820 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c939cce1-f109-4f16-99da-330ff52bf84c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:12.245152 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c939cce1-f109-4f16-99da-330ff52bf84c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:12.245652 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c939cce1-f109-4f16-99da-330ff52bf84c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:12.246093 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c939cce1-f109-4f16-99da-330ff52bf84c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:12.247575 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c939cce1-f109-4f16-99da-330ff52bf84c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:12.248042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c939cce1-f109-4f16-99da-330ff52bf84c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:12.248498 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c939cce1-f109-4f16-99da-330ff52bf84c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:12.280453 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c939cce1-f109-4f16-99da-330ff52bf84c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120543) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 09:04:12.360256 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c939cce1-f109-4f16-99da-330ff52bf84c tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "POST /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e/action" status: 202 len: 0 microversion: 2.1 time: 0.127827 Aug 24 09:04:12.360792 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 486/975] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 24 09:04:12 2022] POST /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:04:12.369788 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-61df8af1-2bed-4140-9b2d-5aa02097b100 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:12.370496 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-61df8af1-2bed-4140-9b2d-5aa02097b100 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:12.377234 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61df8af1-2bed-4140-9b2d-5aa02097b100 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:12.377938 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61df8af1-2bed-4140-9b2d-5aa02097b100 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:12.378628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61df8af1-2bed-4140-9b2d-5aa02097b100 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:12.379562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61df8af1-2bed-4140-9b2d-5aa02097b100 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:12.380872 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61df8af1-2bed-4140-9b2d-5aa02097b100 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:12.381538 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-61df8af1-2bed-4140-9b2d-5aa02097b100 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:12.519582 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-61df8af1-2bed-4140-9b2d-5aa02097b100 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:12.529243 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-61df8af1-2bed-4140-9b2d-5aa02097b100 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1515 microversion: 2.1 time: 0.163518 Aug 24 09:04:12.529811 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 490/976] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:12 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:13.550968 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2a163349-de3b-42e0-906c-a8bef34bc759 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:13.551667 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2a163349-de3b-42e0-906c-a8bef34bc759 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:13.559758 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a163349-de3b-42e0-906c-a8bef34bc759 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:13.560579 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a163349-de3b-42e0-906c-a8bef34bc759 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:13.561024 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a163349-de3b-42e0-906c-a8bef34bc759 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:13.561731 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a163349-de3b-42e0-906c-a8bef34bc759 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:13.562183 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a163349-de3b-42e0-906c-a8bef34bc759 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:13.562603 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a163349-de3b-42e0-906c-a8bef34bc759 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:13.728552 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-2a163349-de3b-42e0-906c-a8bef34bc759 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:13.737409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2a163349-de3b-42e0-906c-a8bef34bc759 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1573 microversion: 2.1 time: 0.190422 Aug 24 09:04:13.752313 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 487/977] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:13 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1573 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:14.761520 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-26aba1ba-2643-4353-bd9a-81b6a7691f22 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:14.762138 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-26aba1ba-2643-4353-bd9a-81b6a7691f22 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:14.768215 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26aba1ba-2643-4353-bd9a-81b6a7691f22 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:14.768706 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26aba1ba-2643-4353-bd9a-81b6a7691f22 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:14.769144 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26aba1ba-2643-4353-bd9a-81b6a7691f22 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:14.769848 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26aba1ba-2643-4353-bd9a-81b6a7691f22 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:14.770300 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26aba1ba-2643-4353-bd9a-81b6a7691f22 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:14.771417 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-26aba1ba-2643-4353-bd9a-81b6a7691f22 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:14.907604 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-26aba1ba-2643-4353-bd9a-81b6a7691f22 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:14.915430 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-26aba1ba-2643-4353-bd9a-81b6a7691f22 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1573 microversion: 2.1 time: 0.157685 Aug 24 09:04:14.915998 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 491/978] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:14 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:15.111462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b93f492f-fb4e-48fc-b5b6-0fe8402c3887 req-3501054f-c557-4326-ac5a-2cb8cb66fb6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4056ca-2520-4b9f-8d6f-818005b9a13e", "name": "network-vif-unplugged", "status": "completed", "tag": "4e9c44c6-d08e-40f7-8605-73a851811f32"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:15.122166 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b93f492f-fb4e-48fc-b5b6-0fe8402c3887 req-3501054f-c557-4326-ac5a-2cb8cb66fb6e service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:15.123079 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b93f492f-fb4e-48fc-b5b6-0fe8402c3887 req-3501054f-c557-4326-ac5a-2cb8cb66fb6e service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:15.123517 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b93f492f-fb4e-48fc-b5b6-0fe8402c3887 req-3501054f-c557-4326-ac5a-2cb8cb66fb6e service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:15.137322 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b93f492f-fb4e-48fc-b5b6-0fe8402c3887 req-3501054f-c557-4326-ac5a-2cb8cb66fb6e service nova] Creating event network-vif-unplugged:4e9c44c6-d08e-40f7-8605-73a851811f32 for instance 8c4056ca-2520-4b9f-8d6f-818005b9a13e on hv-cinder-83538 Aug 24 09:04:15.142348 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b93f492f-fb4e-48fc-b5b6-0fe8402c3887 req-3501054f-c557-4326-ac5a-2cb8cb66fb6e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036166 Aug 24 09:04:15.143251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 488/979] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:15.937527 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5c531e2d-1706-414f-8619-77e9564f9adf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:15.938385 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5c531e2d-1706-414f-8619-77e9564f9adf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:15.944965 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c531e2d-1706-414f-8619-77e9564f9adf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:15.945455 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c531e2d-1706-414f-8619-77e9564f9adf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:15.945890 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c531e2d-1706-414f-8619-77e9564f9adf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:15.946592 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c531e2d-1706-414f-8619-77e9564f9adf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:15.947041 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c531e2d-1706-414f-8619-77e9564f9adf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:15.947465 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5c531e2d-1706-414f-8619-77e9564f9adf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:16.116461 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5c531e2d-1706-414f-8619-77e9564f9adf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:16.124916 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5c531e2d-1706-414f-8619-77e9564f9adf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1573 microversion: 2.1 time: 0.191187 Aug 24 09:04:16.125482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 492/980] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:15 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1573 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:17.148237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-628a096b-d320-4388-a71a-5dad8274134d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:17.148941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-628a096b-d320-4388-a71a-5dad8274134d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:17.155590 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-628a096b-d320-4388-a71a-5dad8274134d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:17.156065 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-628a096b-d320-4388-a71a-5dad8274134d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:17.156519 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-628a096b-d320-4388-a71a-5dad8274134d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:17.157212 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-628a096b-d320-4388-a71a-5dad8274134d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:17.157665 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-628a096b-d320-4388-a71a-5dad8274134d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:17.158089 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-628a096b-d320-4388-a71a-5dad8274134d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:17.294961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-628a096b-d320-4388-a71a-5dad8274134d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:17.303481 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-628a096b-d320-4388-a71a-5dad8274134d tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1573 microversion: 2.1 time: 0.160208 Aug 24 09:04:17.304046 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 489/981] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:17 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:17.742274 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1903673614", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452", "networks": [{"uuid": "4c7c6569-eafc-438a-bfab-4145fe5a90a5"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:17.794580 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] validate_networks() for [('4c7c6569-eafc-438a-bfab-4145fe5a90a5', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:04:18.143691 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:04:18.144140 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:04:18.144618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:04:18.145028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:04:18.145473 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:04:18.156279 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:18.156707 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:18.157143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:18.157875 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:18.158334 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:18.158761 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:18.175492 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Getting quotas for project 3e4a52a4c3744faca37f92db4493357a. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:04:18.179814 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Getting quotas for user a45d5f4ba3284323bb58bb90625ae94f and project 3e4a52a4c3744faca37f92db4493357a. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:04:18.190835 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:04:18.193966 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:04:18.239857 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-819fdb76-1ddc-4bc3-ab03-5835708ad32e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501306 Aug 24 09:04:18.240552 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 493/982] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 09:04:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:04:18.251278 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cc2e1c14-7a6b-49c4-bd0c-81da944c5cd5 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:18.251889 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cc2e1c14-7a6b-49c4-bd0c-81da944c5cd5 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:18.308126 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-cc2e1c14-7a6b-49c4-bd0c-81da944c5cd5 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:18.315237 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cc2e1c14-7a6b-49c4-bd0c-81da944c5cd5 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1219 microversion: 2.1 time: 0.067839 Aug 24 09:04:18.315818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 490/983] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:18 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:18.325220 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8dfe59f1-e300-4ed4-af39-5423823d6fcf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:18.325834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8dfe59f1-e300-4ed4-af39-5423823d6fcf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:18.343146 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8dfe59f1-e300-4ed4-af39-5423823d6fcf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:18.343650 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8dfe59f1-e300-4ed4-af39-5423823d6fcf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:18.344088 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8dfe59f1-e300-4ed4-af39-5423823d6fcf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:18.345788 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8dfe59f1-e300-4ed4-af39-5423823d6fcf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:18.346422 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8dfe59f1-e300-4ed4-af39-5423823d6fcf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:18.346946 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8dfe59f1-e300-4ed4-af39-5423823d6fcf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:18.485306 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8dfe59f1-e300-4ed4-af39-5423823d6fcf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:18.493893 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8dfe59f1-e300-4ed4-af39-5423823d6fcf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1573 microversion: 2.1 time: 0.172458 Aug 24 09:04:18.494479 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 494/984] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:18 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:19.340575 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-36e2388e-e9ba-46a9-b265-d2abbbdc95a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:19.341186 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-36e2388e-e9ba-46a9-b265-d2abbbdc95a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:19.348504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36e2388e-e9ba-46a9-b265-d2abbbdc95a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:19.350104 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36e2388e-e9ba-46a9-b265-d2abbbdc95a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:19.350868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36e2388e-e9ba-46a9-b265-d2abbbdc95a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:19.351836 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36e2388e-e9ba-46a9-b265-d2abbbdc95a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:19.352327 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36e2388e-e9ba-46a9-b265-d2abbbdc95a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:19.352991 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-36e2388e-e9ba-46a9-b265-d2abbbdc95a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:19.428455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-36e2388e-e9ba-46a9-b265-d2abbbdc95a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:19.436569 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-36e2388e-e9ba-46a9-b265-d2abbbdc95a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1277 microversion: 2.1 time: 0.099742 Aug 24 09:04:19.437138 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 491/985] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:19 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:19.514790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-12a027b8-9726-4b80-a305-7a3ac8cacaf5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:19.515533 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-12a027b8-9726-4b80-a305-7a3ac8cacaf5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:19.522225 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12a027b8-9726-4b80-a305-7a3ac8cacaf5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:19.522714 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12a027b8-9726-4b80-a305-7a3ac8cacaf5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:19.523150 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12a027b8-9726-4b80-a305-7a3ac8cacaf5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:19.523864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12a027b8-9726-4b80-a305-7a3ac8cacaf5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:19.524431 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12a027b8-9726-4b80-a305-7a3ac8cacaf5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:19.524872 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-12a027b8-9726-4b80-a305-7a3ac8cacaf5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:19.730591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-12a027b8-9726-4b80-a305-7a3ac8cacaf5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:19.739394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-12a027b8-9726-4b80-a305-7a3ac8cacaf5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1573 microversion: 2.1 time: 0.228418 Aug 24 09:04:19.740426 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 495/986] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:19 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1573 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:20.457920 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1bd007cd-d1a7-4437-b0c7-241da35146ef tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:20.458818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1bd007cd-d1a7-4437-b0c7-241da35146ef tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:20.465581 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bd007cd-d1a7-4437-b0c7-241da35146ef tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:20.466069 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bd007cd-d1a7-4437-b0c7-241da35146ef tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:20.466495 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bd007cd-d1a7-4437-b0c7-241da35146ef tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:20.467195 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bd007cd-d1a7-4437-b0c7-241da35146ef tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:20.467654 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bd007cd-d1a7-4437-b0c7-241da35146ef tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:20.468076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1bd007cd-d1a7-4437-b0c7-241da35146ef tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:20.626778 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-02f94f80-5436-4297-98d8-3c4c128b2fa7 req-f8f3c6d8-4b3d-477c-b88c-8c9e184fc6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c01df6bf-1eb7-43b8-942a-86512183dbdb", "tag": "bbfd1c5c-8091-4dd7-9a66-f977da83ea6f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:20.637777 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-02f94f80-5436-4297-98d8-3c4c128b2fa7 req-f8f3c6d8-4b3d-477c-b88c-8c9e184fc6f7 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:20.638264 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-02f94f80-5436-4297-98d8-3c4c128b2fa7 req-f8f3c6d8-4b3d-477c-b88c-8c9e184fc6f7 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:20.638694 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-02f94f80-5436-4297-98d8-3c4c128b2fa7 req-f8f3c6d8-4b3d-477c-b88c-8c9e184fc6f7 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:20.651140 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-02f94f80-5436-4297-98d8-3c4c128b2fa7 req-f8f3c6d8-4b3d-477c-b88c-8c9e184fc6f7 service nova] Creating event network-changed:bbfd1c5c-8091-4dd7-9a66-f977da83ea6f for instance c01df6bf-1eb7-43b8-942a-86512183dbdb on hv-cinder-83538 Aug 24 09:04:20.656190 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-02f94f80-5436-4297-98d8-3c4c128b2fa7 req-f8f3c6d8-4b3d-477c-b88c-8c9e184fc6f7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034013 Aug 24 09:04:20.656800 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 496/987] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:04:20.684008 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1bd007cd-d1a7-4437-b0c7-241da35146ef tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:20.692421 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1bd007cd-d1a7-4437-b0c7-241da35146ef tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1319 microversion: 2.1 time: 0.238380 Aug 24 09:04:20.693731 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 492/988] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:20 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:20.761074 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-69889131-80d1-4251-bac6-2868f0ecfa89 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:20.761774 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-69889131-80d1-4251-bac6-2868f0ecfa89 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:20.767915 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69889131-80d1-4251-bac6-2868f0ecfa89 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:20.768440 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69889131-80d1-4251-bac6-2868f0ecfa89 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:20.768877 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69889131-80d1-4251-bac6-2868f0ecfa89 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:20.769569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69889131-80d1-4251-bac6-2868f0ecfa89 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:20.770024 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69889131-80d1-4251-bac6-2868f0ecfa89 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:20.770452 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-69889131-80d1-4251-bac6-2868f0ecfa89 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:20.905657 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-69889131-80d1-4251-bac6-2868f0ecfa89 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:20.914412 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-69889131-80d1-4251-bac6-2868f0ecfa89 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1573 microversion: 2.1 time: 0.157536 Aug 24 09:04:20.914928 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 497/989] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:20 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:21.714091 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4243cf9c-9c1e-4054-81cb-b1c17218276b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:21.714709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4243cf9c-9c1e-4054-81cb-b1c17218276b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:21.721411 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4243cf9c-9c1e-4054-81cb-b1c17218276b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:21.721903 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4243cf9c-9c1e-4054-81cb-b1c17218276b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:21.722341 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4243cf9c-9c1e-4054-81cb-b1c17218276b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:21.723047 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4243cf9c-9c1e-4054-81cb-b1c17218276b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:21.723506 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4243cf9c-9c1e-4054-81cb-b1c17218276b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:21.723935 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4243cf9c-9c1e-4054-81cb-b1c17218276b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:21.853640 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-4243cf9c-9c1e-4054-81cb-b1c17218276b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:21.861205 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4243cf9c-9c1e-4054-81cb-b1c17218276b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1319 microversion: 2.1 time: 0.151060 Aug 24 09:04:21.861766 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 493/990] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:21 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:21.936250 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9ebc7ff9-7081-4286-8f39-95ee7ba6ac87 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:21.936862 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9ebc7ff9-7081-4286-8f39-95ee7ba6ac87 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:21.943568 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ebc7ff9-7081-4286-8f39-95ee7ba6ac87 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:21.944145 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ebc7ff9-7081-4286-8f39-95ee7ba6ac87 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:21.944587 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ebc7ff9-7081-4286-8f39-95ee7ba6ac87 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:21.945290 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ebc7ff9-7081-4286-8f39-95ee7ba6ac87 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:21.945743 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ebc7ff9-7081-4286-8f39-95ee7ba6ac87 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:21.946167 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ebc7ff9-7081-4286-8f39-95ee7ba6ac87 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:22.531805 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9ebc7ff9-7081-4286-8f39-95ee7ba6ac87 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:22.535378 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:22.540770 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9ebc7ff9-7081-4286-8f39-95ee7ba6ac87 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1573 microversion: 2.1 time: 0.608490 Aug 24 09:04:22.541340 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 498/991] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:21 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1573 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:22.882961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a0b9c03a-58ae-43e4-a23a-d3d59da6f854 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:22.883495 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a0b9c03a-58ae-43e4-a23a-d3d59da6f854 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:22.890127 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0b9c03a-58ae-43e4-a23a-d3d59da6f854 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:22.890615 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0b9c03a-58ae-43e4-a23a-d3d59da6f854 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:22.891050 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0b9c03a-58ae-43e4-a23a-d3d59da6f854 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:22.891756 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0b9c03a-58ae-43e4-a23a-d3d59da6f854 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:22.892240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0b9c03a-58ae-43e4-a23a-d3d59da6f854 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:22.892689 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a0b9c03a-58ae-43e4-a23a-d3d59da6f854 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:23.031901 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a0b9c03a-58ae-43e4-a23a-d3d59da6f854 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:23.042350 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a0b9c03a-58ae-43e4-a23a-d3d59da6f854 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1319 microversion: 2.1 time: 0.163980 Aug 24 09:04:23.042925 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 494/992] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:22 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:23.562818 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3a5c2427-d188-4b43-b3fe-5deb2a70afdc tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:23.563378 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3a5c2427-d188-4b43-b3fe-5deb2a70afdc tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:23.570478 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a5c2427-d188-4b43-b3fe-5deb2a70afdc tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:23.570962 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a5c2427-d188-4b43-b3fe-5deb2a70afdc tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:23.571397 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a5c2427-d188-4b43-b3fe-5deb2a70afdc tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:23.572115 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a5c2427-d188-4b43-b3fe-5deb2a70afdc tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:23.572587 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a5c2427-d188-4b43-b3fe-5deb2a70afdc tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:23.573017 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3a5c2427-d188-4b43-b3fe-5deb2a70afdc tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:23.705174 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3a5c2427-d188-4b43-b3fe-5deb2a70afdc tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:23.713292 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3a5c2427-d188-4b43-b3fe-5deb2a70afdc tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1573 microversion: 2.1 time: 0.154982 Aug 24 09:04:23.713853 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 499/993] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:23 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:24.064811 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9edea7e4-dab9-4f91-be2b-2087ec44c9d2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:24.065464 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9edea7e4-dab9-4f91-be2b-2087ec44c9d2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:24.072207 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9edea7e4-dab9-4f91-be2b-2087ec44c9d2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:24.072694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9edea7e4-dab9-4f91-be2b-2087ec44c9d2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:24.073131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9edea7e4-dab9-4f91-be2b-2087ec44c9d2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:24.073824 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9edea7e4-dab9-4f91-be2b-2087ec44c9d2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:24.074281 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9edea7e4-dab9-4f91-be2b-2087ec44c9d2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:24.074708 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9edea7e4-dab9-4f91-be2b-2087ec44c9d2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:24.212615 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9edea7e4-dab9-4f91-be2b-2087ec44c9d2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:24.220484 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9edea7e4-dab9-4f91-be2b-2087ec44c9d2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1319 microversion: 2.1 time: 0.159548 Aug 24 09:04:24.221052 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 495/994] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:24 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:24.735678 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8055915b-d308-4c47-a20c-faf6db9d7b02 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:24.736386 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8055915b-d308-4c47-a20c-faf6db9d7b02 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:24.743546 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8055915b-d308-4c47-a20c-faf6db9d7b02 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:24.743772 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8055915b-d308-4c47-a20c-faf6db9d7b02 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:24.744247 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8055915b-d308-4c47-a20c-faf6db9d7b02 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:24.744957 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8055915b-d308-4c47-a20c-faf6db9d7b02 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:24.745416 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8055915b-d308-4c47-a20c-faf6db9d7b02 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:24.745845 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8055915b-d308-4c47-a20c-faf6db9d7b02 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:24.877291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8055915b-d308-4c47-a20c-faf6db9d7b02 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:24.885997 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8055915b-d308-4c47-a20c-faf6db9d7b02 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1573 microversion: 2.1 time: 0.155051 Aug 24 09:04:24.886567 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 500/995] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:24 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:25.174152 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-95aaee0f-050d-416a-ba64-802ba9d66272 req-1040f3d9-3cd0-4141-96fe-91b6a238935a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4056ca-2520-4b9f-8d6f-818005b9a13e", "name": "network-vif-plugged", "status": "completed", "tag": "4e9c44c6-d08e-40f7-8605-73a851811f32"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:25.184707 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-95aaee0f-050d-416a-ba64-802ba9d66272 req-1040f3d9-3cd0-4141-96fe-91b6a238935a service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:25.185196 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-95aaee0f-050d-416a-ba64-802ba9d66272 req-1040f3d9-3cd0-4141-96fe-91b6a238935a service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:25.185631 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-95aaee0f-050d-416a-ba64-802ba9d66272 req-1040f3d9-3cd0-4141-96fe-91b6a238935a service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:25.198330 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-95aaee0f-050d-416a-ba64-802ba9d66272 req-1040f3d9-3cd0-4141-96fe-91b6a238935a service nova] Creating event network-vif-plugged:4e9c44c6-d08e-40f7-8605-73a851811f32 for instance 8c4056ca-2520-4b9f-8d6f-818005b9a13e on hv-cinder-83538 Aug 24 09:04:25.203179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-95aaee0f-050d-416a-ba64-802ba9d66272 req-1040f3d9-3cd0-4141-96fe-91b6a238935a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032764 Aug 24 09:04:25.203771 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 496/996] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:25.241906 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a4e4e55d-495b-4feb-96eb-d44839963ce4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:25.242521 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a4e4e55d-495b-4feb-96eb-d44839963ce4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:25.248456 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4e4e55d-495b-4feb-96eb-d44839963ce4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:25.248950 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4e4e55d-495b-4feb-96eb-d44839963ce4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:25.249363 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4e4e55d-495b-4feb-96eb-d44839963ce4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:25.250047 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4e4e55d-495b-4feb-96eb-d44839963ce4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:25.250499 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4e4e55d-495b-4feb-96eb-d44839963ce4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:25.250919 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a4e4e55d-495b-4feb-96eb-d44839963ce4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:25.379249 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a4e4e55d-495b-4feb-96eb-d44839963ce4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:25.387481 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a4e4e55d-495b-4feb-96eb-d44839963ce4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1319 microversion: 2.1 time: 0.149609 Aug 24 09:04:25.388043 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 501/997] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:25 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:25.907541 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c8911f9a-37f6-4c0f-800f-7dd1bbada423 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:25.908347 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c8911f9a-37f6-4c0f-800f-7dd1bbada423 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:25.915417 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8911f9a-37f6-4c0f-800f-7dd1bbada423 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:25.915904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8911f9a-37f6-4c0f-800f-7dd1bbada423 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:25.916377 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8911f9a-37f6-4c0f-800f-7dd1bbada423 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:25.917074 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8911f9a-37f6-4c0f-800f-7dd1bbada423 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:25.917535 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8911f9a-37f6-4c0f-800f-7dd1bbada423 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:25.917964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c8911f9a-37f6-4c0f-800f-7dd1bbada423 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:26.064217 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c8911f9a-37f6-4c0f-800f-7dd1bbada423 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:26.067743 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:26.073364 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c8911f9a-37f6-4c0f-800f-7dd1bbada423 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1573 microversion: 2.1 time: 0.170283 Aug 24 09:04:26.073919 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 497/998] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:25 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:26.408981 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5bf3e410-0ff8-4f9a-af1e-1f3b1bb74b70 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:26.409618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5bf3e410-0ff8-4f9a-af1e-1f3b1bb74b70 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:26.416929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bf3e410-0ff8-4f9a-af1e-1f3b1bb74b70 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:26.417753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bf3e410-0ff8-4f9a-af1e-1f3b1bb74b70 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:26.418546 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bf3e410-0ff8-4f9a-af1e-1f3b1bb74b70 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:26.420462 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bf3e410-0ff8-4f9a-af1e-1f3b1bb74b70 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:26.420462 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bf3e410-0ff8-4f9a-af1e-1f3b1bb74b70 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:26.420462 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5bf3e410-0ff8-4f9a-af1e-1f3b1bb74b70 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:26.650338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5bf3e410-0ff8-4f9a-af1e-1f3b1bb74b70 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:26.658211 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5bf3e410-0ff8-4f9a-af1e-1f3b1bb74b70 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1319 microversion: 2.1 time: 0.253088 Aug 24 09:04:26.658873 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 502/999] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:26 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:27.094405 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b113b0b4-2046-4825-ba6e-37658e5be900 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:27.095019 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b113b0b4-2046-4825-ba6e-37658e5be900 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:27.103728 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b113b0b4-2046-4825-ba6e-37658e5be900 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:27.104372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b113b0b4-2046-4825-ba6e-37658e5be900 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:27.104818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b113b0b4-2046-4825-ba6e-37658e5be900 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:27.105527 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b113b0b4-2046-4825-ba6e-37658e5be900 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:27.105990 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b113b0b4-2046-4825-ba6e-37658e5be900 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:27.106418 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b113b0b4-2046-4825-ba6e-37658e5be900 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:27.247993 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b113b0b4-2046-4825-ba6e-37658e5be900 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:27.256925 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b113b0b4-2046-4825-ba6e-37658e5be900 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1573 microversion: 2.1 time: 0.166940 Aug 24 09:04:27.257730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 498/1000] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:27 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:27.679322 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dd2403ff-38aa-4ce3-a6d2-7fe889dd3a6b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:27.680206 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dd2403ff-38aa-4ce3-a6d2-7fe889dd3a6b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:27.688137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd2403ff-38aa-4ce3-a6d2-7fe889dd3a6b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:27.688682 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd2403ff-38aa-4ce3-a6d2-7fe889dd3a6b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:27.689126 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd2403ff-38aa-4ce3-a6d2-7fe889dd3a6b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:27.689980 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd2403ff-38aa-4ce3-a6d2-7fe889dd3a6b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:27.690521 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd2403ff-38aa-4ce3-a6d2-7fe889dd3a6b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:27.690954 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dd2403ff-38aa-4ce3-a6d2-7fe889dd3a6b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:27.839706 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-dd2403ff-38aa-4ce3-a6d2-7fe889dd3a6b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:27.847404 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dd2403ff-38aa-4ce3-a6d2-7fe889dd3a6b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1319 microversion: 2.1 time: 0.172321 Aug 24 09:04:27.847995 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 503/1001] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:27 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:28.279205 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c6811b21-cf6a-492c-84c2-ce24c0864a93 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:28.279799 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c6811b21-cf6a-492c-84c2-ce24c0864a93 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:28.286185 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6811b21-cf6a-492c-84c2-ce24c0864a93 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:28.286664 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6811b21-cf6a-492c-84c2-ce24c0864a93 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:28.287344 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6811b21-cf6a-492c-84c2-ce24c0864a93 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:28.288157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6811b21-cf6a-492c-84c2-ce24c0864a93 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:28.288611 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6811b21-cf6a-492c-84c2-ce24c0864a93 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:28.289035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c6811b21-cf6a-492c-84c2-ce24c0864a93 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:28.311931 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:28.440037 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c6811b21-cf6a-492c-84c2-ce24c0864a93 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:28.449578 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c6811b21-cf6a-492c-84c2-ce24c0864a93 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1560 microversion: 2.1 time: 0.174488 Aug 24 09:04:28.450159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 499/1002] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:28 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:28.868404 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f531045d-9b88-443b-9a12-37e08ffb95b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:28.868922 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f531045d-9b88-443b-9a12-37e08ffb95b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:28.870752 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:28.871418 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:28.877065 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f531045d-9b88-443b-9a12-37e08ffb95b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:28.877550 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f531045d-9b88-443b-9a12-37e08ffb95b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:28.878072 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f531045d-9b88-443b-9a12-37e08ffb95b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:28.878687 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f531045d-9b88-443b-9a12-37e08ffb95b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:28.879146 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f531045d-9b88-443b-9a12-37e08ffb95b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:28.879578 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f531045d-9b88-443b-9a12-37e08ffb95b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:29.012567 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f531045d-9b88-443b-9a12-37e08ffb95b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:29.020175 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f531045d-9b88-443b-9a12-37e08ffb95b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1319 microversion: 2.1 time: 0.156217 Aug 24 09:04:29.020749 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 504/1003] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:28 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:29.199362 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-7ae54afa-9f56-49d3-9ea9-7eb73fd5b080 req-9d65bbab-9900-4265-a162-6c869b2951e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01df6bf-1eb7-43b8-942a-86512183dbdb", "name": "network-vif-plugged", "status": "completed", "tag": "bbfd1c5c-8091-4dd7-9a66-f977da83ea6f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:29.204372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:29.211155 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7ae54afa-9f56-49d3-9ea9-7eb73fd5b080 req-9d65bbab-9900-4265-a162-6c869b2951e3 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:29.211656 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7ae54afa-9f56-49d3-9ea9-7eb73fd5b080 req-9d65bbab-9900-4265-a162-6c869b2951e3 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:29.212173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-7ae54afa-9f56-49d3-9ea9-7eb73fd5b080 req-9d65bbab-9900-4265-a162-6c869b2951e3 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:29.225567 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-7ae54afa-9f56-49d3-9ea9-7eb73fd5b080 req-9d65bbab-9900-4265-a162-6c869b2951e3 service nova] Creating event network-vif-plugged:bbfd1c5c-8091-4dd7-9a66-f977da83ea6f for instance c01df6bf-1eb7-43b8-942a-86512183dbdb on hv-cinder-83538 Aug 24 09:04:29.231123 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-7ae54afa-9f56-49d3-9ea9-7eb73fd5b080 req-9d65bbab-9900-4265-a162-6c869b2951e3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035496 Aug 24 09:04:29.231726 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 500/1004] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:04:30.041567 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d551b9de-a426-4691-b7dd-25ca8e05c60e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:30.042108 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d551b9de-a426-4691-b7dd-25ca8e05c60e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:30.043923 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:30.049066 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d551b9de-a426-4691-b7dd-25ca8e05c60e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:30.049551 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d551b9de-a426-4691-b7dd-25ca8e05c60e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:30.050038 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d551b9de-a426-4691-b7dd-25ca8e05c60e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:30.050730 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d551b9de-a426-4691-b7dd-25ca8e05c60e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:30.051186 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d551b9de-a426-4691-b7dd-25ca8e05c60e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:30.051609 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d551b9de-a426-4691-b7dd-25ca8e05c60e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:30.189257 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d551b9de-a426-4691-b7dd-25ca8e05c60e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:30.198111 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d551b9de-a426-4691-b7dd-25ca8e05c60e tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1319 microversion: 2.1 time: 0.161119 Aug 24 09:04:30.198720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 505/1005] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:30 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:31.219342 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-009644fa-6c04-4928-866c-43fc336fc964 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:31.220208 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-009644fa-6c04-4928-866c-43fc336fc964 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:31.227598 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-009644fa-6c04-4928-866c-43fc336fc964 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:31.228086 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-009644fa-6c04-4928-866c-43fc336fc964 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:31.228555 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-009644fa-6c04-4928-866c-43fc336fc964 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:31.229258 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-009644fa-6c04-4928-866c-43fc336fc964 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:31.229749 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-009644fa-6c04-4928-866c-43fc336fc964 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:31.230207 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-009644fa-6c04-4928-866c-43fc336fc964 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:31.360696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-009644fa-6c04-4928-866c-43fc336fc964 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:31.368569 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-009644fa-6c04-4928-866c-43fc336fc964 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1508 microversion: 2.1 time: 0.153511 Aug 24 09:04:31.369121 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 501/1006] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:31 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:32.507562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fa40f077-cf7d-44bc-b429-72deffbf9ee5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:32.508374 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fa40f077-cf7d-44bc-b429-72deffbf9ee5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:32.515565 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa40f077-cf7d-44bc-b429-72deffbf9ee5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:32.516055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa40f077-cf7d-44bc-b429-72deffbf9ee5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:32.516520 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa40f077-cf7d-44bc-b429-72deffbf9ee5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:32.517222 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa40f077-cf7d-44bc-b429-72deffbf9ee5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:32.517686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa40f077-cf7d-44bc-b429-72deffbf9ee5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:32.518111 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fa40f077-cf7d-44bc-b429-72deffbf9ee5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:32.543464 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fa40f077-cf7d-44bc-b429-72deffbf9ee5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e/ips" status: 200 len: 149 microversion: 2.1 time: 0.040481 Aug 24 09:04:32.544044 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 506/1007] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 24 09:04:32 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:33.893977 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9e47d394-ffb7-4143-95e6-b8cf29ccd514 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55824c79-e46c-4f02-a8fb-daee0c601f59"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:33.896416 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9e47d394-ffb7-4143-95e6-b8cf29ccd514 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:33.903558 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e47d394-ffb7-4143-95e6-b8cf29ccd514 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:33.904056 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e47d394-ffb7-4143-95e6-b8cf29ccd514 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:33.904969 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e47d394-ffb7-4143-95e6-b8cf29ccd514 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:33.905682 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e47d394-ffb7-4143-95e6-b8cf29ccd514 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:33.906147 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e47d394-ffb7-4143-95e6-b8cf29ccd514 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:33.906578 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9e47d394-ffb7-4143-95e6-b8cf29ccd514 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:34.162000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9e47d394-ffb7-4143-95e6-b8cf29ccd514 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "POST /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271842 Aug 24 09:04:34.163266 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 502/1008] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 24 09:04:33 2022] POST /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:36.399760 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ab4ee906-7766-4bff-a82b-6f876bf7ce4c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:36.400385 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ab4ee906-7766-4bff-a82b-6f876bf7ce4c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:36.407335 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab4ee906-7766-4bff-a82b-6f876bf7ce4c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:36.407829 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab4ee906-7766-4bff-a82b-6f876bf7ce4c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:36.408305 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab4ee906-7766-4bff-a82b-6f876bf7ce4c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:36.409017 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab4ee906-7766-4bff-a82b-6f876bf7ce4c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:36.409477 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab4ee906-7766-4bff-a82b-6f876bf7ce4c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:36.409906 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ab4ee906-7766-4bff-a82b-6f876bf7ce4c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:36.434288 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ab4ee906-7766-4bff-a82b-6f876bf7ce4c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca/ips" status: 200 len: 150 microversion: 2.20 time: 0.038998 Aug 24 09:04:36.434865 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 507/1009] 10.222.0.67 () {60 vars in 1289 bytes} [Wed Aug 24 09:04:36 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:04:38.524866 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-60c5e970-6ca3-45cf-8b22-5c6b00589af3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:38.525480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-60c5e970-6ca3-45cf-8b22-5c6b00589af3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:38.532920 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60c5e970-6ca3-45cf-8b22-5c6b00589af3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:38.533418 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60c5e970-6ca3-45cf-8b22-5c6b00589af3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:38.533860 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60c5e970-6ca3-45cf-8b22-5c6b00589af3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:38.534576 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60c5e970-6ca3-45cf-8b22-5c6b00589af3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:38.535023 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60c5e970-6ca3-45cf-8b22-5c6b00589af3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:38.535443 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-60c5e970-6ca3-45cf-8b22-5c6b00589af3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:38.558895 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-60c5e970-6ca3-45cf-8b22-5c6b00589af3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lazy-loading 'flavor' on Instance uuid e05dfbb2-5e47-4ddf-897d-10e19be499ca {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:04:38.757198 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-60c5e970-6ca3-45cf-8b22-5c6b00589af3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "POST /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca/action" status: 202 len: 0 microversion: 2.20 time: 0.237131 Aug 24 09:04:38.762201 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 503/1010] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 24 09:04:38 2022] POST /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:04:38.768651 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-16cdfa00-9c32-401d-97c6-351f8de7260c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:38.769733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-16cdfa00-9c32-401d-97c6-351f8de7260c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:38.777011 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16cdfa00-9c32-401d-97c6-351f8de7260c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:38.777468 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16cdfa00-9c32-401d-97c6-351f8de7260c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:38.777914 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16cdfa00-9c32-401d-97c6-351f8de7260c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:38.779321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16cdfa00-9c32-401d-97c6-351f8de7260c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:38.780352 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16cdfa00-9c32-401d-97c6-351f8de7260c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:38.780793 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-16cdfa00-9c32-401d-97c6-351f8de7260c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:38.974057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-16cdfa00-9c32-401d-97c6-351f8de7260c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:38.983059 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-16cdfa00-9c32-401d-97c6-351f8de7260c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:38.984727 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-16cdfa00-9c32-401d-97c6-351f8de7260c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:38.985983 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-16cdfa00-9c32-401d-97c6-351f8de7260c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.221856 Aug 24 09:04:38.986621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 508/1011] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:38 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:04:40.011525 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cc7382b7-06d9-4ef6-862a-a1576dd73915 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:40.012335 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cc7382b7-06d9-4ef6-862a-a1576dd73915 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:40.020048 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc7382b7-06d9-4ef6-862a-a1576dd73915 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:40.020623 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc7382b7-06d9-4ef6-862a-a1576dd73915 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:40.021198 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc7382b7-06d9-4ef6-862a-a1576dd73915 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:40.021940 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc7382b7-06d9-4ef6-862a-a1576dd73915 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:40.022404 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc7382b7-06d9-4ef6-862a-a1576dd73915 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:40.022835 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc7382b7-06d9-4ef6-862a-a1576dd73915 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:40.156338 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-cc7382b7-06d9-4ef6-862a-a1576dd73915 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:40.164520 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-cc7382b7-06d9-4ef6-862a-a1576dd73915 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:40.166050 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-cc7382b7-06d9-4ef6-862a-a1576dd73915 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:40.167878 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cc7382b7-06d9-4ef6-862a-a1576dd73915 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.162143 Aug 24 09:04:40.168463 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 504/1012] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:40 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:41.192416 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e21ae0ec-6856-4128-86eb-a18f669b1645 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:41.193062 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e21ae0ec-6856-4128-86eb-a18f669b1645 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:41.199887 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e21ae0ec-6856-4128-86eb-a18f669b1645 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:41.200547 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e21ae0ec-6856-4128-86eb-a18f669b1645 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:41.200995 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e21ae0ec-6856-4128-86eb-a18f669b1645 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:41.201697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e21ae0ec-6856-4128-86eb-a18f669b1645 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:41.202161 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e21ae0ec-6856-4128-86eb-a18f669b1645 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:41.202591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e21ae0ec-6856-4128-86eb-a18f669b1645 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:41.347363 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e21ae0ec-6856-4128-86eb-a18f669b1645 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:41.356318 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e21ae0ec-6856-4128-86eb-a18f669b1645 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:41.357852 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e21ae0ec-6856-4128-86eb-a18f669b1645 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:41.359044 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e21ae0ec-6856-4128-86eb-a18f669b1645 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.172014 Aug 24 09:04:41.359604 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 509/1013] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:41 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:41.711279 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-685a7443-df16-4844-b5ec-d6fca8bfb0df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55824c79-e46c-4f02-a8fb-daee0c601f59"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:41.713800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-685a7443-df16-4844-b5ec-d6fca8bfb0df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:41.720333 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-685a7443-df16-4844-b5ec-d6fca8bfb0df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:41.720820 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-685a7443-df16-4844-b5ec-d6fca8bfb0df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:41.721253 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-685a7443-df16-4844-b5ec-d6fca8bfb0df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:41.721948 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-685a7443-df16-4844-b5ec-d6fca8bfb0df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:41.722395 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-685a7443-df16-4844-b5ec-d6fca8bfb0df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:41.722810 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-685a7443-df16-4844-b5ec-d6fca8bfb0df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:41.805706 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-685a7443-df16-4844-b5ec-d6fca8bfb0df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] HTTP exception thrown: Invalid volume: volume 55824c79-e46c-4f02-a8fb-daee0c601f59 is already attached to instances: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-685a7443-df16-4844-b5ec-d6fca8bfb0df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Request method failure captured: Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: POST /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e/os-volume_attachments HTTP/1.1 Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 74 Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeebN0Zobm2z9rP6Ekh4dDHbb3SuIkLHnpc3jkEcaHX4GwAfCoUa-aKWg_1MrmPsv97hdPp9j0fQ8hJI9Rp88PNgp2Z4khPlc0lMhYOfsdGUEPCdmARxQAqvXejsu5r4s5TUgAt8jNrxZH2x0zVTldxkuHkKggh8MFCnTglnQHmP2Dw Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:04:41.807644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:04:41.809645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:04:41.809645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:04:41.809645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:04:41.809645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:04:41.809645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:04:41.809645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:04:41.809645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:04:41.809645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: bd0929f371e4442eb4eb6e12a96bbfc4 Aug 24 09:04:41.809645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:04:41.809645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Aug 24 09:04:41.809645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {"volumeAttachment": {"volumeId": "55824c79-e46c-4f02-a8fb-daee0c601f59"}} Aug 24 09:04:41.809645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Invalid volume: volume 55824c79-e46c-4f02-a8fb-daee0c601f59 is already attached to instances: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'server_id': '4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e', 'body': {'volumeAttachment': {'volumeId': '55824c79-e46c-4f02-a8fb-daee0c601f59'}}} Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 55824c79-e46c-4f02-a8fb-daee0c601f59 is already attached to instances: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:04:41.810455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 55824c79-e46c-4f02-a8fb-daee0c601f59 is already attached to instances: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:41.811881 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:04:41.813720 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:04:41.813720 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:04:41.813720 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:04:41.813720 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 55824c79-e46c-4f02-a8fb-daee0c601f59 is already attached to instances: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e Aug 24 09:04:41.813720 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:04:41.813720 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-685a7443-df16-4844-b5ec-d6fca8bfb0df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Returning 400 to user: Invalid volume: volume 55824c79-e46c-4f02-a8fb-daee0c601f59 is already attached to instances: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:04:41.813720 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-685a7443-df16-4844-b5ec-d6fca8bfb0df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "POST /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102336 Aug 24 09:04:41.813720 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 505/1014] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 24 09:04:41 2022] POST /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:04:41.874151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c41f5bb8-44f5-43e2-8bbd-94ef41f92437 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:41.874638 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c41f5bb8-44f5-43e2-8bbd-94ef41f92437 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:41.880509 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c41f5bb8-44f5-43e2-8bbd-94ef41f92437 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:41.880992 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c41f5bb8-44f5-43e2-8bbd-94ef41f92437 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:41.881423 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c41f5bb8-44f5-43e2-8bbd-94ef41f92437 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:41.882105 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c41f5bb8-44f5-43e2-8bbd-94ef41f92437 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:41.882565 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c41f5bb8-44f5-43e2-8bbd-94ef41f92437 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:41.882980 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c41f5bb8-44f5-43e2-8bbd-94ef41f92437 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:41.966013 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-c41f5bb8-44f5-43e2-8bbd-94ef41f92437 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lazy-loading 'services' on Instance uuid 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:04:42.039104 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c41f5bb8-44f5-43e2-8bbd-94ef41f92437 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e/os-volume_attachments/55824c79-e46c-4f02-a8fb-daee0c601f59" status: 202 len: 0 microversion: 2.1 time: 0.169360 Aug 24 09:04:42.039697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 510/1015] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 24 09:04:41 2022] DELETE /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e/os-volume_attachments/55824c79-e46c-4f02-a8fb-daee0c601f59 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:04:42.049962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b2a699ad-dad2-44ff-b73a-dab81cfa95d3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:42.052240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b2a699ad-dad2-44ff-b73a-dab81cfa95d3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:42.060782 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2a699ad-dad2-44ff-b73a-dab81cfa95d3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:42.061903 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2a699ad-dad2-44ff-b73a-dab81cfa95d3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:42.062331 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2a699ad-dad2-44ff-b73a-dab81cfa95d3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:42.063042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2a699ad-dad2-44ff-b73a-dab81cfa95d3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:42.064209 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2a699ad-dad2-44ff-b73a-dab81cfa95d3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:42.064533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b2a699ad-dad2-44ff-b73a-dab81cfa95d3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:42.097503 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b2a699ad-dad2-44ff-b73a-dab81cfa95d3 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051610 Aug 24 09:04:42.098056 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 506/1016] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:04:42 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:42.383720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-db499895-c05e-4d04-86ea-c9e4d674add2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:42.384469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-db499895-c05e-4d04-86ea-c9e4d674add2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:42.392440 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db499895-c05e-4d04-86ea-c9e4d674add2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:42.392941 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db499895-c05e-4d04-86ea-c9e4d674add2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:42.393393 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db499895-c05e-4d04-86ea-c9e4d674add2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:42.395130 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db499895-c05e-4d04-86ea-c9e4d674add2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:42.395130 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db499895-c05e-4d04-86ea-c9e4d674add2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:42.395362 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-db499895-c05e-4d04-86ea-c9e4d674add2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:42.532951 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-db499895-c05e-4d04-86ea-c9e4d674add2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:42.541274 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-db499895-c05e-4d04-86ea-c9e4d674add2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:42.545337 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-db499895-c05e-4d04-86ea-c9e4d674add2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:42.547248 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-db499895-c05e-4d04-86ea-c9e4d674add2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.167223 Aug 24 09:04:42.547816 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 511/1017] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:42 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:43.110443 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9cf0b587-7473-495f-b212-0bd26d8db16d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:43.112582 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9cf0b587-7473-495f-b212-0bd26d8db16d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:43.119392 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9cf0b587-7473-495f-b212-0bd26d8db16d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:43.120475 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9cf0b587-7473-495f-b212-0bd26d8db16d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:43.121879 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9cf0b587-7473-495f-b212-0bd26d8db16d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:43.121879 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9cf0b587-7473-495f-b212-0bd26d8db16d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:43.122140 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9cf0b587-7473-495f-b212-0bd26d8db16d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:43.122522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9cf0b587-7473-495f-b212-0bd26d8db16d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:43.154983 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9cf0b587-7473-495f-b212-0bd26d8db16d tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048507 Aug 24 09:04:43.155841 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 507/1018] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:04:43 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:04:43.225750 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f75a7295-f1d2-495f-b40e-18c78cef2868 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:43.226248 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f75a7295-f1d2-495f-b40e-18c78cef2868 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:43.232722 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f75a7295-f1d2-495f-b40e-18c78cef2868 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:43.233234 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f75a7295-f1d2-495f-b40e-18c78cef2868 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:43.233675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f75a7295-f1d2-495f-b40e-18c78cef2868 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:43.234426 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f75a7295-f1d2-495f-b40e-18c78cef2868 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:43.234936 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f75a7295-f1d2-495f-b40e-18c78cef2868 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:43.235365 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f75a7295-f1d2-495f-b40e-18c78cef2868 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:43.261577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f75a7295-f1d2-495f-b40e-18c78cef2868 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:04:43.342210 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f75a7295-f1d2-495f-b40e-18c78cef2868 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 204 len: 0 microversion: 2.1 time: 0.120008 Aug 24 09:04:43.342973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 512/1019] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:04:43 2022] DELETE /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:04:43.351921 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8575d999-37a1-414c-90de-cda77af20dc6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:43.352580 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8575d999-37a1-414c-90de-cda77af20dc6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:43.359896 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8575d999-37a1-414c-90de-cda77af20dc6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:43.360439 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8575d999-37a1-414c-90de-cda77af20dc6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:43.361164 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8575d999-37a1-414c-90de-cda77af20dc6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:43.361830 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8575d999-37a1-414c-90de-cda77af20dc6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:43.362379 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8575d999-37a1-414c-90de-cda77af20dc6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:43.362819 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8575d999-37a1-414c-90de-cda77af20dc6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:43.499117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8575d999-37a1-414c-90de-cda77af20dc6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:43.506956 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8575d999-37a1-414c-90de-cda77af20dc6 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1681 microversion: 2.1 time: 0.159158 Aug 24 09:04:43.507516 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 508/1020] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:43 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:43.571265 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c13e3ae9-dd8c-4488-b7c4-e617135b6d6c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:43.571969 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c13e3ae9-dd8c-4488-b7c4-e617135b6d6c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:43.578159 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c13e3ae9-dd8c-4488-b7c4-e617135b6d6c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:43.578656 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c13e3ae9-dd8c-4488-b7c4-e617135b6d6c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:43.579101 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c13e3ae9-dd8c-4488-b7c4-e617135b6d6c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:43.579804 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c13e3ae9-dd8c-4488-b7c4-e617135b6d6c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:43.580303 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c13e3ae9-dd8c-4488-b7c4-e617135b6d6c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:43.580732 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c13e3ae9-dd8c-4488-b7c4-e617135b6d6c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:43.718027 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c13e3ae9-dd8c-4488-b7c4-e617135b6d6c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:43.721570 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:43.727192 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c13e3ae9-dd8c-4488-b7c4-e617135b6d6c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:43.728736 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c13e3ae9-dd8c-4488-b7c4-e617135b6d6c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:43.730553 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c13e3ae9-dd8c-4488-b7c4-e617135b6d6c tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.163568 Aug 24 09:04:43.731112 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 513/1021] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:43 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:44.528693 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fc581f5f-0c99-4775-b561-e60cb56cdede tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:44.529296 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fc581f5f-0c99-4775-b561-e60cb56cdede tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:44.536174 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc581f5f-0c99-4775-b561-e60cb56cdede tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:44.536666 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc581f5f-0c99-4775-b561-e60cb56cdede tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:44.537106 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc581f5f-0c99-4775-b561-e60cb56cdede tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:44.537799 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc581f5f-0c99-4775-b561-e60cb56cdede tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:44.538258 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc581f5f-0c99-4775-b561-e60cb56cdede tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:44.538684 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fc581f5f-0c99-4775-b561-e60cb56cdede tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:44.670147 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-fc581f5f-0c99-4775-b561-e60cb56cdede tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:44.677903 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fc581f5f-0c99-4775-b561-e60cb56cdede tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1681 microversion: 2.1 time: 0.153165 Aug 24 09:04:44.678471 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 509/1022] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:44 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:44.753231 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-40bb2fb2-49c5-4cd1-959e-1590b927f881 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:44.753847 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-40bb2fb2-49c5-4cd1-959e-1590b927f881 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:44.761322 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40bb2fb2-49c5-4cd1-959e-1590b927f881 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:44.761809 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40bb2fb2-49c5-4cd1-959e-1590b927f881 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:44.762258 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40bb2fb2-49c5-4cd1-959e-1590b927f881 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:44.762957 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40bb2fb2-49c5-4cd1-959e-1590b927f881 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:44.763420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40bb2fb2-49c5-4cd1-959e-1590b927f881 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:44.763849 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-40bb2fb2-49c5-4cd1-959e-1590b927f881 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:44.899862 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-40bb2fb2-49c5-4cd1-959e-1590b927f881 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:44.909484 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-40bb2fb2-49c5-4cd1-959e-1590b927f881 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:44.910987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-40bb2fb2-49c5-4cd1-959e-1590b927f881 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:44.912188 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-40bb2fb2-49c5-4cd1-959e-1590b927f881 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.162836 Aug 24 09:04:44.912745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 514/1023] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:44 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:45.700211 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2fc1c2ba-9f26-4006-af88-32c4708b8549 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:45.700805 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2fc1c2ba-9f26-4006-af88-32c4708b8549 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:45.707350 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fc1c2ba-9f26-4006-af88-32c4708b8549 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:45.707837 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fc1c2ba-9f26-4006-af88-32c4708b8549 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:45.708301 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fc1c2ba-9f26-4006-af88-32c4708b8549 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:45.709022 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fc1c2ba-9f26-4006-af88-32c4708b8549 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:45.709453 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fc1c2ba-9f26-4006-af88-32c4708b8549 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:45.709879 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2fc1c2ba-9f26-4006-af88-32c4708b8549 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:45.936066 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-753f4f5f-904a-410a-bc87-2db3071dc0f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:45.936687 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-753f4f5f-904a-410a-bc87-2db3071dc0f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:45.943184 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-753f4f5f-904a-410a-bc87-2db3071dc0f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:45.943184 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-753f4f5f-904a-410a-bc87-2db3071dc0f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:45.943463 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-753f4f5f-904a-410a-bc87-2db3071dc0f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:45.944118 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-753f4f5f-904a-410a-bc87-2db3071dc0f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:45.944575 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-753f4f5f-904a-410a-bc87-2db3071dc0f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:45.944994 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-753f4f5f-904a-410a-bc87-2db3071dc0f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:45.967913 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-2fc1c2ba-9f26-4006-af88-32c4708b8549 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:45.976518 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2fc1c2ba-9f26-4006-af88-32c4708b8549 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1681 microversion: 2.1 time: 0.280778 Aug 24 09:04:45.977247 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 510/1024] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:45 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1681 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:46.181229 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-753f4f5f-904a-410a-bc87-2db3071dc0f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:46.191392 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-753f4f5f-904a-410a-bc87-2db3071dc0f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:46.192969 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-753f4f5f-904a-410a-bc87-2db3071dc0f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:46.194184 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-753f4f5f-904a-410a-bc87-2db3071dc0f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.262637 Aug 24 09:04:46.194745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 515/1025] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:45 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:04:46.701067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4bef823c-d1e6-4464-8007-f577b5b51e3b req-da307d23-284a-4450-8e8a-7e5b44f9acba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e", "name": "network-vif-deleted", "tag": "41c1036f-bd6c-4b24-a83a-4bde96f59c6c"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:46.711683 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4bef823c-d1e6-4464-8007-f577b5b51e3b req-da307d23-284a-4450-8e8a-7e5b44f9acba service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:46.712197 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4bef823c-d1e6-4464-8007-f577b5b51e3b req-da307d23-284a-4450-8e8a-7e5b44f9acba service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:46.712628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4bef823c-d1e6-4464-8007-f577b5b51e3b req-da307d23-284a-4450-8e8a-7e5b44f9acba service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:46.726025 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4bef823c-d1e6-4464-8007-f577b5b51e3b req-da307d23-284a-4450-8e8a-7e5b44f9acba service nova] Creating event network-vif-deleted:41c1036f-bd6c-4b24-a83a-4bde96f59c6c for instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e on hv-cinder-83538 Aug 24 09:04:46.738670 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4bef823c-d1e6-4464-8007-f577b5b51e3b req-da307d23-284a-4450-8e8a-7e5b44f9acba service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041509 Aug 24 09:04:46.739593 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 511/1026] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:46.998538 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0857089c-a717-4b0d-b394-9a47b82cc795 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:46.999098 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0857089c-a717-4b0d-b394-9a47b82cc795 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:47.005355 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0857089c-a717-4b0d-b394-9a47b82cc795 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:47.005852 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0857089c-a717-4b0d-b394-9a47b82cc795 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:47.006296 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0857089c-a717-4b0d-b394-9a47b82cc795 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:47.007031 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0857089c-a717-4b0d-b394-9a47b82cc795 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:47.007460 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0857089c-a717-4b0d-b394-9a47b82cc795 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:47.007886 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0857089c-a717-4b0d-b394-9a47b82cc795 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:47.042068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0857089c-a717-4b0d-b394-9a47b82cc795 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:47.042553 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0857089c-a717-4b0d-b394-9a47b82cc795 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:47.042994 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0857089c-a717-4b0d-b394-9a47b82cc795 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:47.043446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-0857089c-a717-4b0d-b394-9a47b82cc795 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lazy-loading 'fault' on Instance uuid 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:04:47.085415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0857089c-a717-4b0d-b394-9a47b82cc795 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:47.094587 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0857089c-a717-4b0d-b394-9a47b82cc795 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 200 len: 1332 microversion: 2.1 time: 0.100078 Aug 24 09:04:47.095225 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 516/1027] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:46 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:47.218157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-06d177ea-6048-4ed3-abba-e247a9c8228d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:47.218865 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-06d177ea-6048-4ed3-abba-e247a9c8228d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:47.226041 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06d177ea-6048-4ed3-abba-e247a9c8228d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:47.226767 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06d177ea-6048-4ed3-abba-e247a9c8228d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:47.227417 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06d177ea-6048-4ed3-abba-e247a9c8228d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:47.228351 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06d177ea-6048-4ed3-abba-e247a9c8228d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:47.228790 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06d177ea-6048-4ed3-abba-e247a9c8228d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:47.229235 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-06d177ea-6048-4ed3-abba-e247a9c8228d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:47.249236 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:47.379392 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-06d177ea-6048-4ed3-abba-e247a9c8228d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:47.388868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-06d177ea-6048-4ed3-abba-e247a9c8228d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:47.390225 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-06d177ea-6048-4ed3-abba-e247a9c8228d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:47.391448 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-06d177ea-6048-4ed3-abba-e247a9c8228d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.177538 Aug 24 09:04:47.392009 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 512/1028] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:47 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:48.116237 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-00bf7991-8e26-44d3-ba60-9232ab8c3218 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:48.116846 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-00bf7991-8e26-44d3-ba60-9232ab8c3218 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:48.122946 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00bf7991-8e26-44d3-ba60-9232ab8c3218 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:48.123423 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00bf7991-8e26-44d3-ba60-9232ab8c3218 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:48.123860 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00bf7991-8e26-44d3-ba60-9232ab8c3218 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:48.124573 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00bf7991-8e26-44d3-ba60-9232ab8c3218 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:48.125025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00bf7991-8e26-44d3-ba60-9232ab8c3218 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:48.125448 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-00bf7991-8e26-44d3-ba60-9232ab8c3218 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:48.138759 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-00bf7991-8e26-44d3-ba60-9232ab8c3218 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] HTTP exception thrown: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-00bf7991-8e26-44d3-ba60-9232ab8c3218 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Request method failure captured: Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e HTTP/1.1 Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeebN0Zobm2z9rP6Ekh4dDHbb3SuIkLHnpc3jkEcaHX4GwAfCoUa-aKWg_1MrmPsv97hdPp9j0fQ8hJI9Rp88PNgp2Z4khPlc0lMhYOfsdGUEPCdmARxQAqvXejsu5r4s5TUgAt8jNrxZH2x0zVTldxkuHkKggh8MFCnTglnQHmP2Dw Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:04:48.140447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:04:48.142029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:04:48.142029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:04:48.142029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:04:48.142029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:04:48.142029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:04:48.142029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:04:48.142029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:04:48.142029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: bd0929f371e4442eb4eb6e12a96bbfc4 Aug 24 09:04:48.142029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:04:48.142029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:04:48.142029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. Aug 24 09:04:48.142029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e'} Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:04:48.142947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. Aug 24 09:04:48.144469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:04:48.145840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-00bf7991-8e26-44d3-ba60-9232ab8c3218 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Returning 404 to user: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:04:48.145840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-00bf7991-8e26-44d3-ba60-9232ab8c3218 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 404 len: 111 microversion: 2.1 time: 0.029618 Aug 24 09:04:48.145840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 517/1029] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:48 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:04:48.150952 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1e738916-3a72-48d5-a2e8-51ea8c105885 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '.version_select at 0x7fb1456c9160>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:48.171778 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1e738916-3a72-48d5-a2e8-51ea8c105885 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962717688" status: 202 len: 0 microversion: 2.1 time: 0.024589 Aug 24 09:04:48.172374 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 513/1030] 10.222.0.67 () {58 vars in 1221 bytes} [Wed Aug 24 09:04:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962717688 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:04:48.414947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-149c0df8-a793-4887-866d-3003500cfc13 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:48.415935 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-149c0df8-a793-4887-866d-3003500cfc13 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:48.422378 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-149c0df8-a793-4887-866d-3003500cfc13 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:48.422858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-149c0df8-a793-4887-866d-3003500cfc13 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:48.423288 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-149c0df8-a793-4887-866d-3003500cfc13 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:48.423974 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-149c0df8-a793-4887-866d-3003500cfc13 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:48.424451 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-149c0df8-a793-4887-866d-3003500cfc13 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:48.424869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-149c0df8-a793-4887-866d-3003500cfc13 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:48.561414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-149c0df8-a793-4887-866d-3003500cfc13 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:48.570009 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-149c0df8-a793-4887-866d-3003500cfc13 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:48.571482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-149c0df8-a793-4887-866d-3003500cfc13 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:48.572698 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-149c0df8-a793-4887-866d-3003500cfc13 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.162049 Aug 24 09:04:48.573747 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 518/1031] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:48 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:04:49.012812 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b4d3d7c0-c85e-4cc5-b2d0-edd981ad9d02 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Action: 'create', calling method: .version_select at 0x7fb14550e9d0>, body: {"keypair": {"name": "tempest-keypair-47336056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcgMFVfZWVnm4Ve5N8K9ilfqyxf7HubZVWp+/9SQ0qPXPtdQeT/K014C24JZIcDb9fqLGAUHTrLWJEcvVzX7IkGjR/FlcY0Urtg3gk3DJESs863/g1g1NFdzGuoAbGycw=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:49.028923 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-b4d3d7c0-c85e-4cc5-b2d0-edd981ad9d02 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Getting quotas for project 7e6183eeb3ff43e79eccb5d7ad08c53c. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:04:49.033047 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-b4d3d7c0-c85e-4cc5-b2d0-edd981ad9d02 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Getting quotas for user bd0929f371e4442eb4eb6e12a96bbfc4 and project 7e6183eeb3ff43e79eccb5d7ad08c53c. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:04:49.055659 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b4d3d7c0-c85e-4cc5-b2d0-edd981ad9d02 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.047553 Aug 24 09:04:49.056283 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 514/1032] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 24 09:04:49 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:49.595705 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e935fb97-6420-4c48-a79b-7c39ad288d49 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:49.596509 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e935fb97-6420-4c48-a79b-7c39ad288d49 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:49.602567 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e935fb97-6420-4c48-a79b-7c39ad288d49 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:49.603042 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e935fb97-6420-4c48-a79b-7c39ad288d49 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:49.603474 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e935fb97-6420-4c48-a79b-7c39ad288d49 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:49.604250 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e935fb97-6420-4c48-a79b-7c39ad288d49 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:49.605353 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e935fb97-6420-4c48-a79b-7c39ad288d49 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:49.605779 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e935fb97-6420-4c48-a79b-7c39ad288d49 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:49.742426 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e935fb97-6420-4c48-a79b-7c39ad288d49 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:49.754982 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e935fb97-6420-4c48-a79b-7c39ad288d49 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:49.757028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e935fb97-6420-4c48-a79b-7c39ad288d49 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:49.758335 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e935fb97-6420-4c48-a79b-7c39ad288d49 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.166644 Aug 24 09:04:49.759566 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 519/1033] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:49 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:50.403157 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-302005218", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42dddf86-1ed2-4180-bf35-64505e861ee8"}], "security_groups": [{"name": "tempest-securitygroup--364033411"}], "key_name": "tempest-keypair-47336056", "user_data": "}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:50.527696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.network.neutron [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] validate_networks() for [('42dddf86-1ed2-4180-bf35-64505e861ee8', None, None, None, None, None)] {{(pid=120543) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:04:50.782971 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dc4ad6f0-7d52-4961-aa66-4accb3c00f86 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:50.783742 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dc4ad6f0-7d52-4961-aa66-4accb3c00f86 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:50.790941 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc4ad6f0-7d52-4961-aa66-4accb3c00f86 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:50.791799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc4ad6f0-7d52-4961-aa66-4accb3c00f86 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:50.792950 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc4ad6f0-7d52-4961-aa66-4accb3c00f86 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:50.793833 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc4ad6f0-7d52-4961-aa66-4accb3c00f86 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:50.794659 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc4ad6f0-7d52-4961-aa66-4accb3c00f86 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:50.795367 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc4ad6f0-7d52-4961-aa66-4accb3c00f86 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:51.030479 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-dc4ad6f0-7d52-4961-aa66-4accb3c00f86 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:51.039197 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-dc4ad6f0-7d52-4961-aa66-4accb3c00f86 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:51.040798 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-dc4ad6f0-7d52-4961-aa66-4accb3c00f86 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:51.042073 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dc4ad6f0-7d52-4961-aa66-4accb3c00f86 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.264152 Aug 24 09:04:51.043152 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 520/1034] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:50 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:51.059082 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Flavor limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:04:51.059508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Image limits 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:04:51.059988 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Flavor pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:04:51.060432 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Image pref 0:0:0 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:04:51.060854 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.virt.hardware [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120543) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:04:51.069743 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:51.070228 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:51.070667 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:51.071399 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:51.071882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:51.072497 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:51.089520 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Getting quotas for project 7e6183eeb3ff43e79eccb5d7ad08c53c. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:04:51.093545 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Getting quotas for user bd0929f371e4442eb4eb6e12a96bbfc4 and project 7e6183eeb3ff43e79eccb5d7ad08c53c. Resources: {'cores', 'ram', 'instances'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:04:51.104585 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Going to run 1 instances... {{(pid=120543) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:04:51.107371 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120543) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:04:51.157039 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-24b755f3-3291-4cd1-b1b8-b33be6cd07b8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.759015 Aug 24 09:04:51.157685 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 515/1035] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 09:04:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:04:51.169173 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-72409fa7-2450-4a60-9897-368206ff6f9c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:51.169787 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-72409fa7-2450-4a60-9897-368206ff6f9c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:51.224823 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-72409fa7-2450-4a60-9897-368206ff6f9c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:51.233078 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-72409fa7-2450-4a60-9897-368206ff6f9c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 200 len: 1239 microversion: 2.1 time: 0.068376 Aug 24 09:04:51.233668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 521/1036] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:51 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:52.066490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-adb15fa3-5459-49a4-9841-8670b32a9a90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:52.067074 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-adb15fa3-5459-49a4-9841-8670b32a9a90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:52.075181 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adb15fa3-5459-49a4-9841-8670b32a9a90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:52.075630 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adb15fa3-5459-49a4-9841-8670b32a9a90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:52.076208 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adb15fa3-5459-49a4-9841-8670b32a9a90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:52.076910 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adb15fa3-5459-49a4-9841-8670b32a9a90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:52.077371 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adb15fa3-5459-49a4-9841-8670b32a9a90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:52.077805 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-adb15fa3-5459-49a4-9841-8670b32a9a90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:52.255485 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0698dee9-9101-41c0-9744-7bccd93eb0ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:52.257535 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0698dee9-9101-41c0-9744-7bccd93eb0ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:52.265107 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0698dee9-9101-41c0-9744-7bccd93eb0ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:52.265880 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0698dee9-9101-41c0-9744-7bccd93eb0ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:52.266479 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0698dee9-9101-41c0-9744-7bccd93eb0ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:52.267990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0698dee9-9101-41c0-9744-7bccd93eb0ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:52.268619 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0698dee9-9101-41c0-9744-7bccd93eb0ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:52.269147 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0698dee9-9101-41c0-9744-7bccd93eb0ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:52.294523 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-adb15fa3-5459-49a4-9841-8670b32a9a90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:52.304715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-adb15fa3-5459-49a4-9841-8670b32a9a90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:52.306282 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-adb15fa3-5459-49a4-9841-8670b32a9a90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:52.307544 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-adb15fa3-5459-49a4-9841-8670b32a9a90 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.245588 Aug 24 09:04:52.308983 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 516/1037] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:52 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:52.355998 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0698dee9-9101-41c0-9744-7bccd93eb0ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:52.363907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0698dee9-9101-41c0-9744-7bccd93eb0ac tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 200 len: 1297 microversion: 2.1 time: 0.113645 Aug 24 09:04:52.364516 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 522/1038] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:52 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 1297 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:53.330928 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5162279f-a36d-4d07-94a4-bc5cffd814f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:53.331560 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5162279f-a36d-4d07-94a4-bc5cffd814f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:53.337986 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5162279f-a36d-4d07-94a4-bc5cffd814f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:53.338480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5162279f-a36d-4d07-94a4-bc5cffd814f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:53.338927 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5162279f-a36d-4d07-94a4-bc5cffd814f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:53.339988 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5162279f-a36d-4d07-94a4-bc5cffd814f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:53.340403 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5162279f-a36d-4d07-94a4-bc5cffd814f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:53.340836 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5162279f-a36d-4d07-94a4-bc5cffd814f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:53.385695 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bf2225ed-4eb7-4cc1-bbcf-b58962943cef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:53.387295 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bf2225ed-4eb7-4cc1-bbcf-b58962943cef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:53.393380 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf2225ed-4eb7-4cc1-bbcf-b58962943cef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:53.393860 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf2225ed-4eb7-4cc1-bbcf-b58962943cef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:53.394288 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf2225ed-4eb7-4cc1-bbcf-b58962943cef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:53.394974 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf2225ed-4eb7-4cc1-bbcf-b58962943cef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:53.395423 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf2225ed-4eb7-4cc1-bbcf-b58962943cef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:53.395840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bf2225ed-4eb7-4cc1-bbcf-b58962943cef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:53.898405 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5162279f-a36d-4d07-94a4-bc5cffd814f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:53.907011 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5162279f-a36d-4d07-94a4-bc5cffd814f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:53.908552 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5162279f-a36d-4d07-94a4-bc5cffd814f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:53.909736 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5162279f-a36d-4d07-94a4-bc5cffd814f1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.582835 Aug 24 09:04:53.910292 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 517/1039] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:53 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:53.911234 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-bf2225ed-4eb7-4cc1-bbcf-b58962943cef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:53.920010 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bf2225ed-4eb7-4cc1-bbcf-b58962943cef tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 200 len: 1364 microversion: 2.1 time: 0.538236 Aug 24 09:04:53.920927 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 523/1040] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:53 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 1364 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:53.995775 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b9046f9c-f388-48f9-8e75-0bb04c3b50b1 req-b1710485-e434-4bbd-92d1-d880adefe6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c4f039-665a-4517-b881-a573445044f9", "tag": "238d5301-2a72-4f87-b032-af7b25cb6e2d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:54.019443 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b9046f9c-f388-48f9-8e75-0bb04c3b50b1 req-b1710485-e434-4bbd-92d1-d880adefe6ac service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:54.019927 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b9046f9c-f388-48f9-8e75-0bb04c3b50b1 req-b1710485-e434-4bbd-92d1-d880adefe6ac service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:54.020442 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b9046f9c-f388-48f9-8e75-0bb04c3b50b1 req-b1710485-e434-4bbd-92d1-d880adefe6ac service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:54.033039 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b9046f9c-f388-48f9-8e75-0bb04c3b50b1 req-b1710485-e434-4bbd-92d1-d880adefe6ac service nova] Creating event network-changed:238d5301-2a72-4f87-b032-af7b25cb6e2d for instance 19c4f039-665a-4517-b881-a573445044f9 on hv-cinder-83538 Aug 24 09:04:54.038033 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b9046f9c-f388-48f9-8e75-0bb04c3b50b1 req-b1710485-e434-4bbd-92d1-d880adefe6ac service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048599 Aug 24 09:04:54.038712 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 518/1041] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:54.934087 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-80e409ba-d617-447f-a552-93f6a4a250a6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:54.934733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-80e409ba-d617-447f-a552-93f6a4a250a6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:54.940871 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80e409ba-d617-447f-a552-93f6a4a250a6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:54.941366 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80e409ba-d617-447f-a552-93f6a4a250a6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:54.941800 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80e409ba-d617-447f-a552-93f6a4a250a6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:54.942110 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7da05e87-6cfb-4441-80ac-d2146aba83f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:54.942559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80e409ba-d617-447f-a552-93f6a4a250a6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:54.942802 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7da05e87-6cfb-4441-80ac-d2146aba83f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:54.942955 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80e409ba-d617-447f-a552-93f6a4a250a6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:54.943377 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-80e409ba-d617-447f-a552-93f6a4a250a6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:54.949617 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7da05e87-6cfb-4441-80ac-d2146aba83f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:54.950185 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7da05e87-6cfb-4441-80ac-d2146aba83f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:54.950617 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7da05e87-6cfb-4441-80ac-d2146aba83f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:54.951302 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7da05e87-6cfb-4441-80ac-d2146aba83f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:54.951752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7da05e87-6cfb-4441-80ac-d2146aba83f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:54.952191 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7da05e87-6cfb-4441-80ac-d2146aba83f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:55.143116 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-80e409ba-d617-447f-a552-93f6a4a250a6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:55.146418 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7da05e87-6cfb-4441-80ac-d2146aba83f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:55.151559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-80e409ba-d617-447f-a552-93f6a4a250a6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:55.153111 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-80e409ba-d617-447f-a552-93f6a4a250a6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:55.154383 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-80e409ba-d617-447f-a552-93f6a4a250a6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.224802 Aug 24 09:04:55.154553 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7da05e87-6cfb-4441-80ac-d2146aba83f5 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 200 len: 1364 microversion: 2.1 time: 0.216968 Aug 24 09:04:55.154949 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 524/1042] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:54 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:55.155415 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 519/1043] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:54 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:56.176405 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b943fa0-ca5e-4fb7-983a-ae9d5762923b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:56.177107 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6b943fa0-ca5e-4fb7-983a-ae9d5762923b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:56.177722 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-11e6aafb-8ef5-41d8-afc2-6bcc91f537c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:56.178755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-11e6aafb-8ef5-41d8-afc2-6bcc91f537c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:56.183952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b943fa0-ca5e-4fb7-983a-ae9d5762923b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:56.184637 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b943fa0-ca5e-4fb7-983a-ae9d5762923b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:56.184969 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b943fa0-ca5e-4fb7-983a-ae9d5762923b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:56.185694 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b943fa0-ca5e-4fb7-983a-ae9d5762923b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:56.186148 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b943fa0-ca5e-4fb7-983a-ae9d5762923b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:56.186261 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11e6aafb-8ef5-41d8-afc2-6bcc91f537c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:56.186572 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b943fa0-ca5e-4fb7-983a-ae9d5762923b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:56.186688 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11e6aafb-8ef5-41d8-afc2-6bcc91f537c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:56.187169 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11e6aafb-8ef5-41d8-afc2-6bcc91f537c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:56.187917 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11e6aafb-8ef5-41d8-afc2-6bcc91f537c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:56.188410 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11e6aafb-8ef5-41d8-afc2-6bcc91f537c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:56.188925 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-11e6aafb-8ef5-41d8-afc2-6bcc91f537c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:56.390897 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-11e6aafb-8ef5-41d8-afc2-6bcc91f537c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:56.394039 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6b943fa0-ca5e-4fb7-983a-ae9d5762923b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:56.399524 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-11e6aafb-8ef5-41d8-afc2-6bcc91f537c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:56.401050 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-11e6aafb-8ef5-41d8-afc2-6bcc91f537c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:56.401777 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6b943fa0-ca5e-4fb7-983a-ae9d5762923b tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 200 len: 1364 microversion: 2.1 time: 0.229443 Aug 24 09:04:56.402229 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-11e6aafb-8ef5-41d8-afc2-6bcc91f537c6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.228798 Aug 24 09:04:56.402364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 525/1044] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:56 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:56.402766 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 520/1045] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:56 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:04:57.192412 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2e23c4fd-5b09-4308-9cd8-816fa9aee59b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a343ba2-a30d-4612-b647-7ee184063fc0", "device": "/dev/sdb"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:57.196202 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2e23c4fd-5b09-4308-9cd8-816fa9aee59b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:57.203194 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e23c4fd-5b09-4308-9cd8-816fa9aee59b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:57.203688 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e23c4fd-5b09-4308-9cd8-816fa9aee59b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:57.204184 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e23c4fd-5b09-4308-9cd8-816fa9aee59b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:57.204893 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e23c4fd-5b09-4308-9cd8-816fa9aee59b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:57.205362 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e23c4fd-5b09-4308-9cd8-816fa9aee59b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:57.205782 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2e23c4fd-5b09-4308-9cd8-816fa9aee59b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:57.423446 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-80f2f319-4e57-4856-8a0e-8b2063ee6221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:57.424060 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-80f2f319-4e57-4856-8a0e-8b2063ee6221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:57.431102 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80f2f319-4e57-4856-8a0e-8b2063ee6221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:57.431601 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80f2f319-4e57-4856-8a0e-8b2063ee6221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:57.432040 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80f2f319-4e57-4856-8a0e-8b2063ee6221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:57.432774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80f2f319-4e57-4856-8a0e-8b2063ee6221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:57.433830 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80f2f319-4e57-4856-8a0e-8b2063ee6221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:57.434378 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-80f2f319-4e57-4856-8a0e-8b2063ee6221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:57.568333 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-80f2f319-4e57-4856-8a0e-8b2063ee6221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:57.576308 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-80f2f319-4e57-4856-8a0e-8b2063ee6221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 200 len: 1364 microversion: 2.1 time: 0.156814 Aug 24 09:04:57.576873 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 521/1046] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:57 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:04:57.581307 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bfa12f94-cc96-4223-8a14-dd0f5bf5b599 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:57.581912 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bfa12f94-cc96-4223-8a14-dd0f5bf5b599 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:57.588131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfa12f94-cc96-4223-8a14-dd0f5bf5b599 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:57.588638 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfa12f94-cc96-4223-8a14-dd0f5bf5b599 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:57.589081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfa12f94-cc96-4223-8a14-dd0f5bf5b599 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:57.590500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfa12f94-cc96-4223-8a14-dd0f5bf5b599 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:57.590500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfa12f94-cc96-4223-8a14-dd0f5bf5b599 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:57.590834 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bfa12f94-cc96-4223-8a14-dd0f5bf5b599 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:57.719572 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-bfa12f94-cc96-4223-8a14-dd0f5bf5b599 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:57.728021 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-bfa12f94-cc96-4223-8a14-dd0f5bf5b599 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:57.729602 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-bfa12f94-cc96-4223-8a14-dd0f5bf5b599 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:57.731569 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bfa12f94-cc96-4223-8a14-dd0f5bf5b599 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.153579 Aug 24 09:04:57.732152 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 522/1047] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:57 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:57.965178 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2e23c4fd-5b09-4308-9cd8-816fa9aee59b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "POST /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.776133 Aug 24 09:04:57.966034 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 526/1048] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 24 09:04:57 2022] POST /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb/os-volume_attachments => generated 194 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:58.596545 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6a5dc4da-7f1d-4742-bec3-7220dfb13768 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:58.597155 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6a5dc4da-7f1d-4742-bec3-7220dfb13768 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:58.603741 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a5dc4da-7f1d-4742-bec3-7220dfb13768 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:58.604263 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a5dc4da-7f1d-4742-bec3-7220dfb13768 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:58.604693 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a5dc4da-7f1d-4742-bec3-7220dfb13768 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:58.605429 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a5dc4da-7f1d-4742-bec3-7220dfb13768 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:58.605875 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a5dc4da-7f1d-4742-bec3-7220dfb13768 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:58.606292 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a5dc4da-7f1d-4742-bec3-7220dfb13768 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:58.748848 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-6a5dc4da-7f1d-4742-bec3-7220dfb13768 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:58.761023 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1099511a-3f8a-43bd-94d3-a84c62a9d78b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:58.762738 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1099511a-3f8a-43bd-94d3-a84c62a9d78b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:58.764200 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6a5dc4da-7f1d-4742-bec3-7220dfb13768 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 200 len: 1364 microversion: 2.1 time: 0.171196 Aug 24 09:04:58.765279 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 523/1049] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:58 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:58.770494 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1099511a-3f8a-43bd-94d3-a84c62a9d78b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:58.771032 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1099511a-3f8a-43bd-94d3-a84c62a9d78b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:58.771678 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1099511a-3f8a-43bd-94d3-a84c62a9d78b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:58.772641 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1099511a-3f8a-43bd-94d3-a84c62a9d78b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:58.773115 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1099511a-3f8a-43bd-94d3-a84c62a9d78b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:58.773541 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1099511a-3f8a-43bd-94d3-a84c62a9d78b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:58.905631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1099511a-3f8a-43bd-94d3-a84c62a9d78b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:58.914037 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1099511a-3f8a-43bd-94d3-a84c62a9d78b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:58.915560 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1099511a-3f8a-43bd-94d3-a84c62a9d78b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:58.916748 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1099511a-3f8a-43bd-94d3-a84c62a9d78b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.163709 Aug 24 09:04:58.917827 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 527/1050] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:58 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:04:59.320882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-87cd469d-7337-46a8-a9b7-dfd391ed1250 req-83f8e19e-f38f-43b7-862e-c8129e73b905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c4f039-665a-4517-b881-a573445044f9", "name": "network-vif-plugged", "status": "completed", "tag": "238d5301-2a72-4f87-b032-af7b25cb6e2d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:04:59.332898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-87cd469d-7337-46a8-a9b7-dfd391ed1250 req-83f8e19e-f38f-43b7-862e-c8129e73b905 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:59.333389 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-87cd469d-7337-46a8-a9b7-dfd391ed1250 req-83f8e19e-f38f-43b7-862e-c8129e73b905 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:59.333825 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-87cd469d-7337-46a8-a9b7-dfd391ed1250 req-83f8e19e-f38f-43b7-862e-c8129e73b905 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:59.346547 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-87cd469d-7337-46a8-a9b7-dfd391ed1250 req-83f8e19e-f38f-43b7-862e-c8129e73b905 service nova] Creating event network-vif-plugged:238d5301-2a72-4f87-b032-af7b25cb6e2d for instance 19c4f039-665a-4517-b881-a573445044f9 on hv-cinder-83538 Aug 24 09:04:59.351506 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-87cd469d-7337-46a8-a9b7-dfd391ed1250 req-83f8e19e-f38f-43b7-862e-c8129e73b905 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034894 Aug 24 09:04:59.352128 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 524/1051] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:04:59.785265 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-57bae0cf-79ed-4398-99f9-d659154d4ed0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:59.785905 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-57bae0cf-79ed-4398-99f9-d659154d4ed0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:59.792570 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bae0cf-79ed-4398-99f9-d659154d4ed0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:59.793052 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bae0cf-79ed-4398-99f9-d659154d4ed0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:59.793497 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bae0cf-79ed-4398-99f9-d659154d4ed0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:59.794197 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bae0cf-79ed-4398-99f9-d659154d4ed0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:59.794655 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bae0cf-79ed-4398-99f9-d659154d4ed0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:59.795086 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-57bae0cf-79ed-4398-99f9-d659154d4ed0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:59.923787 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-57bae0cf-79ed-4398-99f9-d659154d4ed0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:04:59.931477 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-57bae0cf-79ed-4398-99f9-d659154d4ed0 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 200 len: 1364 microversion: 2.1 time: 0.150413 Aug 24 09:04:59.932044 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 528/1052] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:04:59 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:04:59.941031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9ed2cf2c-99e4-4f17-ac89-5d41426fae59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:04:59.941763 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9ed2cf2c-99e4-4f17-ac89-5d41426fae59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:04:59.947939 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed2cf2c-99e4-4f17-ac89-5d41426fae59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:59.948468 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed2cf2c-99e4-4f17-ac89-5d41426fae59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:59.949563 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed2cf2c-99e4-4f17-ac89-5d41426fae59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:04:59.950262 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed2cf2c-99e4-4f17-ac89-5d41426fae59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:04:59.950724 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed2cf2c-99e4-4f17-ac89-5d41426fae59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:04:59.951153 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9ed2cf2c-99e4-4f17-ac89-5d41426fae59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:00.081415 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ed2cf2c-99e4-4f17-ac89-5d41426fae59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:00.089725 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ed2cf2c-99e4-4f17-ac89-5d41426fae59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:00.091324 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9ed2cf2c-99e4-4f17-ac89-5d41426fae59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:00.092527 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9ed2cf2c-99e4-4f17-ac89-5d41426fae59 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.156234 Aug 24 09:05:00.093086 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 525/1053] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:04:59 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:00.953339 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-face44bb-e3d0-4a64-bebb-f0df50f93dbf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:00.955353 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-face44bb-e3d0-4a64-bebb-f0df50f93dbf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:00.956439 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:00.962276 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-face44bb-e3d0-4a64-bebb-f0df50f93dbf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:00.962780 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-face44bb-e3d0-4a64-bebb-f0df50f93dbf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:00.963222 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-face44bb-e3d0-4a64-bebb-f0df50f93dbf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:00.963928 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-face44bb-e3d0-4a64-bebb-f0df50f93dbf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:00.964959 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-face44bb-e3d0-4a64-bebb-f0df50f93dbf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:00.965386 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-face44bb-e3d0-4a64-bebb-f0df50f93dbf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:01.100751 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-face44bb-e3d0-4a64-bebb-f0df50f93dbf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:01.108701 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-face44bb-e3d0-4a64-bebb-f0df50f93dbf tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 200 len: 1364 microversion: 2.1 time: 0.159598 Aug 24 09:05:01.109449 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 529/1054] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:00 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:01.114864 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-89efc9f9-48fb-4f93-8d65-baa5244add75 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:01.115478 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-89efc9f9-48fb-4f93-8d65-baa5244add75 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:01.117947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:01.118618 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=10 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:01.125219 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89efc9f9-48fb-4f93-8d65-baa5244add75 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:01.125719 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89efc9f9-48fb-4f93-8d65-baa5244add75 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:01.126161 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89efc9f9-48fb-4f93-8d65-baa5244add75 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:01.126869 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89efc9f9-48fb-4f93-8d65-baa5244add75 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:01.127326 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89efc9f9-48fb-4f93-8d65-baa5244add75 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:01.127754 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-89efc9f9-48fb-4f93-8d65-baa5244add75 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:01.270027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-89efc9f9-48fb-4f93-8d65-baa5244add75 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:01.279221 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-89efc9f9-48fb-4f93-8d65-baa5244add75 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:01.280771 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-89efc9f9-48fb-4f93-8d65-baa5244add75 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:01.282281 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-89efc9f9-48fb-4f93-8d65-baa5244add75 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1743 microversion: 2.20 time: 0.171018 Aug 24 09:05:01.282838 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 526/1055] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:01 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:02.129643 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-477e2e8f-217b-453e-bea1-2e5d9645d221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:02.130258 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-477e2e8f-217b-453e-bea1-2e5d9645d221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:02.132115 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:02.138302 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-477e2e8f-217b-453e-bea1-2e5d9645d221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:02.138795 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-477e2e8f-217b-453e-bea1-2e5d9645d221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:02.139235 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-477e2e8f-217b-453e-bea1-2e5d9645d221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:02.139935 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-477e2e8f-217b-453e-bea1-2e5d9645d221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:02.140426 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-477e2e8f-217b-453e-bea1-2e5d9645d221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:02.140858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-477e2e8f-217b-453e-bea1-2e5d9645d221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:02.160299 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:02.281585 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-477e2e8f-217b-453e-bea1-2e5d9645d221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:02.289526 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-477e2e8f-217b-453e-bea1-2e5d9645d221 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 200 len: 1552 microversion: 2.1 time: 0.163823 Aug 24 09:05:02.290084 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 530/1056] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:02 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:02.306160 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3a9ba7ab-d5d0-4272-81ce-2afdeb9473b5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:02.306819 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3a9ba7ab-d5d0-4272-81ce-2afdeb9473b5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:02.309531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:02.311205 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0ec1221f-babf-4f8b-8385-8aab8959d978 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:02.311723 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0ec1221f-babf-4f8b-8385-8aab8959d978 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:02.315613 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a9ba7ab-d5d0-4272-81ce-2afdeb9473b5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:02.316243 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a9ba7ab-d5d0-4272-81ce-2afdeb9473b5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:02.316692 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a9ba7ab-d5d0-4272-81ce-2afdeb9473b5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:02.317400 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a9ba7ab-d5d0-4272-81ce-2afdeb9473b5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:02.317861 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a9ba7ab-d5d0-4272-81ce-2afdeb9473b5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:02.317962 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec1221f-babf-4f8b-8385-8aab8959d978 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:02.318292 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a9ba7ab-d5d0-4272-81ce-2afdeb9473b5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:02.318444 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec1221f-babf-4f8b-8385-8aab8959d978 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:02.318887 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec1221f-babf-4f8b-8385-8aab8959d978 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:02.319588 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec1221f-babf-4f8b-8385-8aab8959d978 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:02.320044 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec1221f-babf-4f8b-8385-8aab8959d978 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:02.320532 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0ec1221f-babf-4f8b-8385-8aab8959d978 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:02.444461 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0ec1221f-babf-4f8b-8385-8aab8959d978 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137497 Aug 24 09:05:02.445264 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 531/1057] 10.222.0.67 () {58 vars in 1275 bytes} [Wed Aug 24 09:05:02 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:05:02.491632 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3a9ba7ab-d5d0-4272-81ce-2afdeb9473b5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:02.499970 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3a9ba7ab-d5d0-4272-81ce-2afdeb9473b5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:02.501499 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3a9ba7ab-d5d0-4272-81ce-2afdeb9473b5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:02.502658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3a9ba7ab-d5d0-4272-81ce-2afdeb9473b5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1743 microversion: 2.20 time: 0.200987 Aug 24 09:05:02.503228 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 527/1058] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:02 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1743 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:03.343203 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-76138960-6ed0-4959-8236-6e141423cdc0 req-ca2b8970-799e-48fa-809f-57317b8b01b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05dfbb2-5e47-4ddf-897d-10e19be499ca", "name": "network-vif-plugged", "status": "completed", "tag": "ca6a6a1a-7c92-4d61-9b26-4ffea23e5485"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:05:03.354160 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-76138960-6ed0-4959-8236-6e141423cdc0 req-ca2b8970-799e-48fa-809f-57317b8b01b8 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:03.354643 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-76138960-6ed0-4959-8236-6e141423cdc0 req-ca2b8970-799e-48fa-809f-57317b8b01b8 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:03.355595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-76138960-6ed0-4959-8236-6e141423cdc0 req-ca2b8970-799e-48fa-809f-57317b8b01b8 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:03.389173 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-76138960-6ed0-4959-8236-6e141423cdc0 req-ca2b8970-799e-48fa-809f-57317b8b01b8 service nova] Creating event network-vif-plugged:ca6a6a1a-7c92-4d61-9b26-4ffea23e5485 for instance e05dfbb2-5e47-4ddf-897d-10e19be499ca on hv-cinder-83538 Aug 24 09:05:03.400894 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-76138960-6ed0-4959-8236-6e141423cdc0 req-ca2b8970-799e-48fa-809f-57317b8b01b8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062137 Aug 24 09:05:03.401749 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 532/1059] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:05:03.525705 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1e88476c-2df3-4ea3-abb1-9e89c642317f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:03.526407 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1e88476c-2df3-4ea3-abb1-9e89c642317f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:03.533080 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e88476c-2df3-4ea3-abb1-9e89c642317f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:03.533862 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e88476c-2df3-4ea3-abb1-9e89c642317f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:03.534516 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e88476c-2df3-4ea3-abb1-9e89c642317f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:03.535420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e88476c-2df3-4ea3-abb1-9e89c642317f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:03.536124 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e88476c-2df3-4ea3-abb1-9e89c642317f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:03.536637 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1e88476c-2df3-4ea3-abb1-9e89c642317f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:03.560063 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-b80d1021-57f8-42ab-80e7-6fe0b65b4056 req-ac68e67a-1c4f-4054-93d1-56b7cb568c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c4f039-665a-4517-b881-a573445044f9", "tag": "238d5301-2a72-4f87-b032-af7b25cb6e2d"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:05:03.570086 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b80d1021-57f8-42ab-80e7-6fe0b65b4056 req-ac68e67a-1c4f-4054-93d1-56b7cb568c56 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:03.571072 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b80d1021-57f8-42ab-80e7-6fe0b65b4056 req-ac68e67a-1c4f-4054-93d1-56b7cb568c56 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:03.571459 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-b80d1021-57f8-42ab-80e7-6fe0b65b4056 req-ac68e67a-1c4f-4054-93d1-56b7cb568c56 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:03.583704 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-b80d1021-57f8-42ab-80e7-6fe0b65b4056 req-ac68e67a-1c4f-4054-93d1-56b7cb568c56 service nova] Creating event network-changed:238d5301-2a72-4f87-b032-af7b25cb6e2d for instance 19c4f039-665a-4517-b881-a573445044f9 on hv-cinder-83538 Aug 24 09:05:03.588946 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-b80d1021-57f8-42ab-80e7-6fe0b65b4056 req-ac68e67a-1c4f-4054-93d1-56b7cb568c56 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197718 Aug 24 09:05:03.590309 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 528/1060] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:05:03.678627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e88476c-2df3-4ea3-abb1-9e89c642317f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:03.687620 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e88476c-2df3-4ea3-abb1-9e89c642317f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:03.689161 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1e88476c-2df3-4ea3-abb1-9e89c642317f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:03.690332 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1e88476c-2df3-4ea3-abb1-9e89c642317f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1743 microversion: 2.20 time: 0.168858 Aug 24 09:05:03.690999 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 533/1061] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:03 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:04.713899 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-148d187a-bdc6-403e-99d1-6c1e78bbdb7a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:04.714541 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-148d187a-bdc6-403e-99d1-6c1e78bbdb7a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:04.721422 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-148d187a-bdc6-403e-99d1-6c1e78bbdb7a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:04.721917 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-148d187a-bdc6-403e-99d1-6c1e78bbdb7a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:04.722359 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-148d187a-bdc6-403e-99d1-6c1e78bbdb7a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:04.723097 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-148d187a-bdc6-403e-99d1-6c1e78bbdb7a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:04.723556 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-148d187a-bdc6-403e-99d1-6c1e78bbdb7a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:04.723984 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-148d187a-bdc6-403e-99d1-6c1e78bbdb7a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:04.965332 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-148d187a-bdc6-403e-99d1-6c1e78bbdb7a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:04.973853 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-148d187a-bdc6-403e-99d1-6c1e78bbdb7a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:04.975373 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-148d187a-bdc6-403e-99d1-6c1e78bbdb7a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:04.976566 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-148d187a-bdc6-403e-99d1-6c1e78bbdb7a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1743 microversion: 2.20 time: 0.267070 Aug 24 09:05:04.977128 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 529/1062] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:04 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1743 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:06.001592 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2cf25eb9-c28c-4912-8d6f-78c847ac542e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:06.002010 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2cf25eb9-c28c-4912-8d6f-78c847ac542e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:06.008606 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cf25eb9-c28c-4912-8d6f-78c847ac542e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:06.009038 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cf25eb9-c28c-4912-8d6f-78c847ac542e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:06.009474 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cf25eb9-c28c-4912-8d6f-78c847ac542e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:06.010170 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cf25eb9-c28c-4912-8d6f-78c847ac542e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:06.010629 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cf25eb9-c28c-4912-8d6f-78c847ac542e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:06.011050 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2cf25eb9-c28c-4912-8d6f-78c847ac542e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:06.146787 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2cf25eb9-c28c-4912-8d6f-78c847ac542e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:06.155286 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2cf25eb9-c28c-4912-8d6f-78c847ac542e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:06.156838 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2cf25eb9-c28c-4912-8d6f-78c847ac542e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:06.163521 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2cf25eb9-c28c-4912-8d6f-78c847ac542e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1743 microversion: 2.20 time: 0.162677 Aug 24 09:05:06.163521 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 534/1063] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:05 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:07.182569 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1b04d595-0768-4e98-9139-ffb7150e2bf8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:07.183189 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1b04d595-0768-4e98-9139-ffb7150e2bf8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:07.190304 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b04d595-0768-4e98-9139-ffb7150e2bf8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:07.190788 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b04d595-0768-4e98-9139-ffb7150e2bf8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:07.191218 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b04d595-0768-4e98-9139-ffb7150e2bf8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:07.191912 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b04d595-0768-4e98-9139-ffb7150e2bf8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:07.192391 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b04d595-0768-4e98-9139-ffb7150e2bf8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:07.192808 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1b04d595-0768-4e98-9139-ffb7150e2bf8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:07.331190 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b04d595-0768-4e98-9139-ffb7150e2bf8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:07.339566 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b04d595-0768-4e98-9139-ffb7150e2bf8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:07.341122 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1b04d595-0768-4e98-9139-ffb7150e2bf8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:07.343122 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1b04d595-0768-4e98-9139-ffb7150e2bf8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1743 microversion: 2.20 time: 0.165884 Aug 24 09:05:07.343677 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 530/1064] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:07 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:08.366174 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21cff844-e1b0-4919-a9bf-31b05ab9d38b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:08.366704 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-21cff844-e1b0-4919-a9bf-31b05ab9d38b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:08.373271 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21cff844-e1b0-4919-a9bf-31b05ab9d38b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:08.374507 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21cff844-e1b0-4919-a9bf-31b05ab9d38b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:08.374923 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21cff844-e1b0-4919-a9bf-31b05ab9d38b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:08.375626 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21cff844-e1b0-4919-a9bf-31b05ab9d38b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:08.376086 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21cff844-e1b0-4919-a9bf-31b05ab9d38b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:08.376533 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21cff844-e1b0-4919-a9bf-31b05ab9d38b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:08.508079 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-21cff844-e1b0-4919-a9bf-31b05ab9d38b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:08.517097 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-21cff844-e1b0-4919-a9bf-31b05ab9d38b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:08.518639 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-21cff844-e1b0-4919-a9bf-31b05ab9d38b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:08.519815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-21cff844-e1b0-4919-a9bf-31b05ab9d38b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1743 microversion: 2.20 time: 0.157621 Aug 24 09:05:08.520444 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 535/1065] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:08 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:09.543711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63447428-25df-44a5-a6e6-c2a4d79e081a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:09.544413 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-63447428-25df-44a5-a6e6-c2a4d79e081a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:09.551500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63447428-25df-44a5-a6e6-c2a4d79e081a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:09.551999 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63447428-25df-44a5-a6e6-c2a4d79e081a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:09.552474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63447428-25df-44a5-a6e6-c2a4d79e081a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:09.553173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63447428-25df-44a5-a6e6-c2a4d79e081a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:09.553634 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63447428-25df-44a5-a6e6-c2a4d79e081a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:09.554064 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63447428-25df-44a5-a6e6-c2a4d79e081a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:09.687240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-63447428-25df-44a5-a6e6-c2a4d79e081a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:09.695425 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-63447428-25df-44a5-a6e6-c2a4d79e081a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:09.696963 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-63447428-25df-44a5-a6e6-c2a4d79e081a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:09.698126 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-63447428-25df-44a5-a6e6-c2a4d79e081a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1743 microversion: 2.20 time: 0.158383 Aug 24 09:05:09.698675 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 531/1066] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:09 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:10.722827 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7bd1353c-ef7c-4338-add3-e56062fa8812 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:10.723379 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7bd1353c-ef7c-4338-add3-e56062fa8812 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:10.730031 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bd1353c-ef7c-4338-add3-e56062fa8812 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:10.730515 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bd1353c-ef7c-4338-add3-e56062fa8812 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:10.730950 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bd1353c-ef7c-4338-add3-e56062fa8812 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:10.731651 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bd1353c-ef7c-4338-add3-e56062fa8812 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:10.732127 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bd1353c-ef7c-4338-add3-e56062fa8812 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:10.732562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7bd1353c-ef7c-4338-add3-e56062fa8812 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:10.863567 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7bd1353c-ef7c-4338-add3-e56062fa8812 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:10.871719 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7bd1353c-ef7c-4338-add3-e56062fa8812 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:10.873364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7bd1353c-ef7c-4338-add3-e56062fa8812 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:10.875939 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7bd1353c-ef7c-4338-add3-e56062fa8812 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1743 microversion: 2.20 time: 0.156793 Aug 24 09:05:10.876943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 536/1067] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:10 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:11.898650 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-425e5842-3fb9-4340-a510-60e34ef957fa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:11.899321 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-425e5842-3fb9-4340-a510-60e34ef957fa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:11.906541 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-425e5842-3fb9-4340-a510-60e34ef957fa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:11.907035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-425e5842-3fb9-4340-a510-60e34ef957fa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:11.907713 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-425e5842-3fb9-4340-a510-60e34ef957fa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:11.908460 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-425e5842-3fb9-4340-a510-60e34ef957fa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:11.908928 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-425e5842-3fb9-4340-a510-60e34ef957fa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:11.909352 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-425e5842-3fb9-4340-a510-60e34ef957fa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:12.054644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-425e5842-3fb9-4340-a510-60e34ef957fa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:12.063553 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-425e5842-3fb9-4340-a510-60e34ef957fa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:12.065102 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-425e5842-3fb9-4340-a510-60e34ef957fa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:12.066271 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-425e5842-3fb9-4340-a510-60e34ef957fa tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1743 microversion: 2.20 time: 0.171511 Aug 24 09:05:12.066826 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 532/1068] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:11 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:13.090560 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-47b99a9e-8848-41d3-bcf3-3440393f01ed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:13.091198 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-47b99a9e-8848-41d3-bcf3-3440393f01ed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:13.097794 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47b99a9e-8848-41d3-bcf3-3440393f01ed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:13.098279 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47b99a9e-8848-41d3-bcf3-3440393f01ed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:13.098717 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47b99a9e-8848-41d3-bcf3-3440393f01ed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:13.099414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47b99a9e-8848-41d3-bcf3-3440393f01ed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:13.099877 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47b99a9e-8848-41d3-bcf3-3440393f01ed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:13.100342 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47b99a9e-8848-41d3-bcf3-3440393f01ed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:13.229162 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-47b99a9e-8848-41d3-bcf3-3440393f01ed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:13.238022 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-47b99a9e-8848-41d3-bcf3-3440393f01ed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:13.239538 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-47b99a9e-8848-41d3-bcf3-3440393f01ed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:13.240741 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-47b99a9e-8848-41d3-bcf3-3440393f01ed tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1743 microversion: 2.20 time: 0.154069 Aug 24 09:05:13.241303 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 537/1069] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:13 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:14.265185 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2a901547-4c38-4e7e-910e-b1ee1399ae2b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:14.265848 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2a901547-4c38-4e7e-910e-b1ee1399ae2b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:14.272372 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a901547-4c38-4e7e-910e-b1ee1399ae2b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:14.272863 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a901547-4c38-4e7e-910e-b1ee1399ae2b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:14.273308 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a901547-4c38-4e7e-910e-b1ee1399ae2b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:14.274020 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a901547-4c38-4e7e-910e-b1ee1399ae2b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:14.274480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a901547-4c38-4e7e-910e-b1ee1399ae2b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:14.274911 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2a901547-4c38-4e7e-910e-b1ee1399ae2b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:14.407098 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-2a901547-4c38-4e7e-910e-b1ee1399ae2b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:14.410954 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=100 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:14.416406 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-2a901547-4c38-4e7e-910e-b1ee1399ae2b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:14.417933 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-2a901547-4c38-4e7e-910e-b1ee1399ae2b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:14.419094 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2a901547-4c38-4e7e-910e-b1ee1399ae2b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1743 microversion: 2.20 time: 0.158597 Aug 24 09:05:14.419642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 533/1070] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:14 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:15.442575 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fc3f9cea-69bd-4040-965c-7c3fcba9fec6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:15.443180 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fc3f9cea-69bd-4040-965c-7c3fcba9fec6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:15.449632 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc3f9cea-69bd-4040-965c-7c3fcba9fec6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:15.450119 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc3f9cea-69bd-4040-965c-7c3fcba9fec6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:15.450553 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc3f9cea-69bd-4040-965c-7c3fcba9fec6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:15.451240 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc3f9cea-69bd-4040-965c-7c3fcba9fec6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:15.451694 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc3f9cea-69bd-4040-965c-7c3fcba9fec6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:15.452176 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc3f9cea-69bd-4040-965c-7c3fcba9fec6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:15.584084 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc3f9cea-69bd-4040-965c-7c3fcba9fec6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:15.592567 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc3f9cea-69bd-4040-965c-7c3fcba9fec6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:15.594722 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-fc3f9cea-69bd-4040-965c-7c3fcba9fec6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:15.595893 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fc3f9cea-69bd-4040-965c-7c3fcba9fec6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1743 microversion: 2.20 time: 0.157228 Aug 24 09:05:15.596493 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 538/1071] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:15 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:16.619446 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9752dd42-aa5b-4492-a081-ae082015472f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:16.620039 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9752dd42-aa5b-4492-a081-ae082015472f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:16.627329 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9752dd42-aa5b-4492-a081-ae082015472f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:16.627819 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9752dd42-aa5b-4492-a081-ae082015472f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:16.628334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9752dd42-aa5b-4492-a081-ae082015472f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:16.629039 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9752dd42-aa5b-4492-a081-ae082015472f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:16.629501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9752dd42-aa5b-4492-a081-ae082015472f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:16.629935 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9752dd42-aa5b-4492-a081-ae082015472f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:16.762333 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9752dd42-aa5b-4492-a081-ae082015472f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:16.771293 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9752dd42-aa5b-4492-a081-ae082015472f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:16.772866 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9752dd42-aa5b-4492-a081-ae082015472f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:16.774031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9752dd42-aa5b-4492-a081-ae082015472f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1743 microversion: 2.20 time: 0.158594 Aug 24 09:05:16.774592 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 534/1072] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:16 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:17.798212 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cffd3672-cb20-48d3-a215-02aa4e6abff1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:17.798904 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cffd3672-cb20-48d3-a215-02aa4e6abff1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:17.805721 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cffd3672-cb20-48d3-a215-02aa4e6abff1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:17.806212 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cffd3672-cb20-48d3-a215-02aa4e6abff1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:17.806657 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cffd3672-cb20-48d3-a215-02aa4e6abff1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:17.807364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cffd3672-cb20-48d3-a215-02aa4e6abff1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:17.807823 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cffd3672-cb20-48d3-a215-02aa4e6abff1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:17.808297 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cffd3672-cb20-48d3-a215-02aa4e6abff1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:17.960258 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cffd3672-cb20-48d3-a215-02aa4e6abff1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:17.972045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cffd3672-cb20-48d3-a215-02aa4e6abff1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:17.974375 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cffd3672-cb20-48d3-a215-02aa4e6abff1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:17.975760 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cffd3672-cb20-48d3-a215-02aa4e6abff1 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1738 microversion: 2.20 time: 0.181844 Aug 24 09:05:17.989899 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 539/1073] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:17 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:19.001845 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8da37ddd-b45a-4e4f-82c8-e8c68b915360 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:19.003178 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8da37ddd-b45a-4e4f-82c8-e8c68b915360 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:19.009770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8da37ddd-b45a-4e4f-82c8-e8c68b915360 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:19.010496 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8da37ddd-b45a-4e4f-82c8-e8c68b915360 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:19.010938 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8da37ddd-b45a-4e4f-82c8-e8c68b915360 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:19.011839 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8da37ddd-b45a-4e4f-82c8-e8c68b915360 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:19.012509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8da37ddd-b45a-4e4f-82c8-e8c68b915360 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:19.013108 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8da37ddd-b45a-4e4f-82c8-e8c68b915360 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:19.159412 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8da37ddd-b45a-4e4f-82c8-e8c68b915360 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:19.168164 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8da37ddd-b45a-4e4f-82c8-e8c68b915360 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:19.169990 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8da37ddd-b45a-4e4f-82c8-e8c68b915360 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:19.171282 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8da37ddd-b45a-4e4f-82c8-e8c68b915360 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1738 microversion: 2.20 time: 0.174349 Aug 24 09:05:19.171843 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 535/1074] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:18 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:20.194829 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5df840cc-9510-4c2e-b852-d28bebe98783 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:20.195775 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5df840cc-9510-4c2e-b852-d28bebe98783 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:20.202996 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5df840cc-9510-4c2e-b852-d28bebe98783 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:20.203750 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5df840cc-9510-4c2e-b852-d28bebe98783 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:20.204072 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5df840cc-9510-4c2e-b852-d28bebe98783 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:20.204898 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5df840cc-9510-4c2e-b852-d28bebe98783 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:20.205615 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5df840cc-9510-4c2e-b852-d28bebe98783 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:20.206121 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5df840cc-9510-4c2e-b852-d28bebe98783 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:20.353243 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5df840cc-9510-4c2e-b852-d28bebe98783 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:20.362797 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5df840cc-9510-4c2e-b852-d28bebe98783 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:20.364366 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5df840cc-9510-4c2e-b852-d28bebe98783 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:20.368259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5df840cc-9510-4c2e-b852-d28bebe98783 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1738 microversion: 2.20 time: 0.174649 Aug 24 09:05:20.369084 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 540/1075] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:20 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:21.391124 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-81d99afe-8c41-4b66-9cc3-55150e50a4c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:21.392027 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-81d99afe-8c41-4b66-9cc3-55150e50a4c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:21.406984 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81d99afe-8c41-4b66-9cc3-55150e50a4c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:21.410011 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81d99afe-8c41-4b66-9cc3-55150e50a4c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:21.410861 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81d99afe-8c41-4b66-9cc3-55150e50a4c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:21.411779 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81d99afe-8c41-4b66-9cc3-55150e50a4c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:21.412280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81d99afe-8c41-4b66-9cc3-55150e50a4c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:21.412709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-81d99afe-8c41-4b66-9cc3-55150e50a4c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:21.565474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-81d99afe-8c41-4b66-9cc3-55150e50a4c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:21.573582 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-81d99afe-8c41-4b66-9cc3-55150e50a4c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:21.575081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-81d99afe-8c41-4b66-9cc3-55150e50a4c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:21.576267 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-81d99afe-8c41-4b66-9cc3-55150e50a4c7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1738 microversion: 2.20 time: 0.189101 Aug 24 09:05:21.576815 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 536/1076] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:21 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:22.599138 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-232a5e2b-8c96-4f03-af24-13da6a3e6afc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:22.599749 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-232a5e2b-8c96-4f03-af24-13da6a3e6afc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:22.610868 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-232a5e2b-8c96-4f03-af24-13da6a3e6afc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:22.611370 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-232a5e2b-8c96-4f03-af24-13da6a3e6afc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:22.611813 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-232a5e2b-8c96-4f03-af24-13da6a3e6afc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:22.612551 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-232a5e2b-8c96-4f03-af24-13da6a3e6afc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:22.613013 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-232a5e2b-8c96-4f03-af24-13da6a3e6afc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:22.613676 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-232a5e2b-8c96-4f03-af24-13da6a3e6afc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:22.760720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-232a5e2b-8c96-4f03-af24-13da6a3e6afc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:22.769900 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-232a5e2b-8c96-4f03-af24-13da6a3e6afc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:22.771541 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-232a5e2b-8c96-4f03-af24-13da6a3e6afc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:22.772900 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-232a5e2b-8c96-4f03-af24-13da6a3e6afc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1738 microversion: 2.20 time: 0.177929 Aug 24 09:05:22.773461 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 541/1077] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:22 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:23.796877 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-886a856c-f55e-4954-825d-3542a6bae7c5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:23.797877 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-886a856c-f55e-4954-825d-3542a6bae7c5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:23.805651 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-886a856c-f55e-4954-825d-3542a6bae7c5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:23.806162 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-886a856c-f55e-4954-825d-3542a6bae7c5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:23.806607 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-886a856c-f55e-4954-825d-3542a6bae7c5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:23.807344 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-886a856c-f55e-4954-825d-3542a6bae7c5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:23.808018 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-886a856c-f55e-4954-825d-3542a6bae7c5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:23.808483 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-886a856c-f55e-4954-825d-3542a6bae7c5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:23.952935 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-886a856c-f55e-4954-825d-3542a6bae7c5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:23.961820 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-886a856c-f55e-4954-825d-3542a6bae7c5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:23.963352 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-886a856c-f55e-4954-825d-3542a6bae7c5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:23.964573 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-886a856c-f55e-4954-825d-3542a6bae7c5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1738 microversion: 2.20 time: 0.171810 Aug 24 09:05:23.973073 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 537/1078] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:23 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:24.990169 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f73b957c-7bec-4c56-9b01-4f35dca98345 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:24.990820 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f73b957c-7bec-4c56-9b01-4f35dca98345 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:24.997596 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f73b957c-7bec-4c56-9b01-4f35dca98345 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:24.998080 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f73b957c-7bec-4c56-9b01-4f35dca98345 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:24.998554 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f73b957c-7bec-4c56-9b01-4f35dca98345 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:24.999246 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f73b957c-7bec-4c56-9b01-4f35dca98345 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:24.999697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f73b957c-7bec-4c56-9b01-4f35dca98345 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:25.000171 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f73b957c-7bec-4c56-9b01-4f35dca98345 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:25.153919 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f73b957c-7bec-4c56-9b01-4f35dca98345 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:25.166761 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f73b957c-7bec-4c56-9b01-4f35dca98345 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:25.168845 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f73b957c-7bec-4c56-9b01-4f35dca98345 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:25.170417 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f73b957c-7bec-4c56-9b01-4f35dca98345 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1738 microversion: 2.20 time: 0.184881 Aug 24 09:05:25.171276 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 542/1079] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:24 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:26.198556 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-93093205-89f5-4426-bf57-79e2942ef76d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:26.199251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-93093205-89f5-4426-bf57-79e2942ef76d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:26.206574 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93093205-89f5-4426-bf57-79e2942ef76d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:26.207068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93093205-89f5-4426-bf57-79e2942ef76d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:26.207500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93093205-89f5-4426-bf57-79e2942ef76d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:26.208228 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93093205-89f5-4426-bf57-79e2942ef76d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:26.208698 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93093205-89f5-4426-bf57-79e2942ef76d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:26.209118 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-93093205-89f5-4426-bf57-79e2942ef76d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:26.348218 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-93093205-89f5-4426-bf57-79e2942ef76d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:26.357454 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-93093205-89f5-4426-bf57-79e2942ef76d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:26.359309 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-93093205-89f5-4426-bf57-79e2942ef76d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:26.360721 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-93093205-89f5-4426-bf57-79e2942ef76d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1738 microversion: 2.20 time: 0.166352 Aug 24 09:05:26.361566 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 538/1080] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:26 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:27.384610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-56997341-8341-4216-955e-b8c835d9e6d2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:27.385439 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-56997341-8341-4216-955e-b8c835d9e6d2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:27.391902 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56997341-8341-4216-955e-b8c835d9e6d2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:27.392560 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56997341-8341-4216-955e-b8c835d9e6d2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:27.393091 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56997341-8341-4216-955e-b8c835d9e6d2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:27.393883 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56997341-8341-4216-955e-b8c835d9e6d2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:27.394427 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56997341-8341-4216-955e-b8c835d9e6d2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:27.394969 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-56997341-8341-4216-955e-b8c835d9e6d2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:27.543703 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-56997341-8341-4216-955e-b8c835d9e6d2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:27.553264 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-56997341-8341-4216-955e-b8c835d9e6d2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:27.554999 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-56997341-8341-4216-955e-b8c835d9e6d2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:27.556190 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-56997341-8341-4216-955e-b8c835d9e6d2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1738 microversion: 2.20 time: 0.175905 Aug 24 09:05:27.556744 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 543/1081] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:27 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:28.579579 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-23d9fad9-9547-420e-a60f-94d8261ec2e8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:28.580217 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-23d9fad9-9547-420e-a60f-94d8261ec2e8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:28.586672 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23d9fad9-9547-420e-a60f-94d8261ec2e8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:28.587161 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23d9fad9-9547-420e-a60f-94d8261ec2e8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:28.587599 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23d9fad9-9547-420e-a60f-94d8261ec2e8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:28.588335 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23d9fad9-9547-420e-a60f-94d8261ec2e8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:28.588800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23d9fad9-9547-420e-a60f-94d8261ec2e8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:28.589231 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-23d9fad9-9547-420e-a60f-94d8261ec2e8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:28.721756 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-23d9fad9-9547-420e-a60f-94d8261ec2e8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:28.729964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-23d9fad9-9547-420e-a60f-94d8261ec2e8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:28.731467 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-23d9fad9-9547-420e-a60f-94d8261ec2e8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:28.732659 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-23d9fad9-9547-420e-a60f-94d8261ec2e8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1738 microversion: 2.20 time: 0.157833 Aug 24 09:05:28.733203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 539/1082] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:28 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:29.757000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-94580332-6fc0-40e3-aaa1-2e43823a5d6d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:29.757620 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-94580332-6fc0-40e3-aaa1-2e43823a5d6d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:29.764065 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94580332-6fc0-40e3-aaa1-2e43823a5d6d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:29.764589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94580332-6fc0-40e3-aaa1-2e43823a5d6d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:29.765534 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94580332-6fc0-40e3-aaa1-2e43823a5d6d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:29.766234 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94580332-6fc0-40e3-aaa1-2e43823a5d6d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:29.766695 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94580332-6fc0-40e3-aaa1-2e43823a5d6d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:29.767124 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-94580332-6fc0-40e3-aaa1-2e43823a5d6d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:29.894588 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-94580332-6fc0-40e3-aaa1-2e43823a5d6d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:29.903024 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-94580332-6fc0-40e3-aaa1-2e43823a5d6d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:29.904566 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-94580332-6fc0-40e3-aaa1-2e43823a5d6d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:29.905966 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-94580332-6fc0-40e3-aaa1-2e43823a5d6d tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1738 microversion: 2.20 time: 0.152757 Aug 24 09:05:29.906799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 544/1083] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:29 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:30.929011 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2bf1ce24-c59c-4bbb-94a2-23ddc79824cc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:30.929692 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2bf1ce24-c59c-4bbb-94a2-23ddc79824cc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:30.936195 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bf1ce24-c59c-4bbb-94a2-23ddc79824cc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:30.936864 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bf1ce24-c59c-4bbb-94a2-23ddc79824cc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:30.937316 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bf1ce24-c59c-4bbb-94a2-23ddc79824cc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:30.938024 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bf1ce24-c59c-4bbb-94a2-23ddc79824cc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:30.938490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bf1ce24-c59c-4bbb-94a2-23ddc79824cc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:30.938922 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2bf1ce24-c59c-4bbb-94a2-23ddc79824cc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:31.123783 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-2bf1ce24-c59c-4bbb-94a2-23ddc79824cc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:31.133434 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-2bf1ce24-c59c-4bbb-94a2-23ddc79824cc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:31.134933 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-2bf1ce24-c59c-4bbb-94a2-23ddc79824cc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:31.136121 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2bf1ce24-c59c-4bbb-94a2-23ddc79824cc tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1738 microversion: 2.20 time: 0.211061 Aug 24 09:05:31.136677 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 540/1084] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:30 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:32.159771 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ae158ab1-91d5-42df-84c6-1c9fc685f5a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:32.160677 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ae158ab1-91d5-42df-84c6-1c9fc685f5a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:32.163275 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=32 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:32.168924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae158ab1-91d5-42df-84c6-1c9fc685f5a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:32.169307 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae158ab1-91d5-42df-84c6-1c9fc685f5a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:32.169759 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae158ab1-91d5-42df-84c6-1c9fc685f5a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:32.170431 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae158ab1-91d5-42df-84c6-1c9fc685f5a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:32.170887 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae158ab1-91d5-42df-84c6-1c9fc685f5a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:32.171317 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ae158ab1-91d5-42df-84c6-1c9fc685f5a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:32.189803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=83 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:32.311096 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ae158ab1-91d5-42df-84c6-1c9fc685f5a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:32.319463 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ae158ab1-91d5-42df-84c6-1c9fc685f5a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:32.321015 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ae158ab1-91d5-42df-84c6-1c9fc685f5a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:32.322232 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ae158ab1-91d5-42df-84c6-1c9fc685f5a0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1738 microversion: 2.20 time: 0.167525 Aug 24 09:05:32.322975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 545/1085] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:32 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:33.208697 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cc2e9912-db19-47e2-ae9f-9b14afe280b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:33.209229 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cc2e9912-db19-47e2-ae9f-9b14afe280b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:33.211541 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=28 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:33.217150 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc2e9912-db19-47e2-ae9f-9b14afe280b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:33.217644 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc2e9912-db19-47e2-ae9f-9b14afe280b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:33.218088 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc2e9912-db19-47e2-ae9f-9b14afe280b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:33.218802 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc2e9912-db19-47e2-ae9f-9b14afe280b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:33.219263 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc2e9912-db19-47e2-ae9f-9b14afe280b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:33.219689 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cc2e9912-db19-47e2-ae9f-9b14afe280b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:33.311698 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-cc2e9912-db19-47e2-ae9f-9b14afe280b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lazy-loading 'services' on Instance uuid c01df6bf-1eb7-43b8-942a-86512183dbdb {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:05:33.344840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-72392c07-e4e3-4600-9d3d-48beebf0aab2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:33.345604 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-72392c07-e4e3-4600-9d3d-48beebf0aab2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:33.352227 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72392c07-e4e3-4600-9d3d-48beebf0aab2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:33.352717 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72392c07-e4e3-4600-9d3d-48beebf0aab2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:33.353151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72392c07-e4e3-4600-9d3d-48beebf0aab2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:33.354641 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72392c07-e4e3-4600-9d3d-48beebf0aab2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:33.355287 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72392c07-e4e3-4600-9d3d-48beebf0aab2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:33.355900 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-72392c07-e4e3-4600-9d3d-48beebf0aab2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:33.415988 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cc2e9912-db19-47e2-ae9f-9b14afe280b8 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb/os-volume_attachments/2a343ba2-a30d-4612-b647-7ee184063fc0" status: 202 len: 0 microversion: 2.1 time: 0.210936 Aug 24 09:05:33.416641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 541/1086] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 24 09:05:33 2022] DELETE /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb/os-volume_attachments/2a343ba2-a30d-4612-b647-7ee184063fc0 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:05:33.652818 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-72392c07-e4e3-4600-9d3d-48beebf0aab2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:33.662217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-72392c07-e4e3-4600-9d3d-48beebf0aab2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:33.663715 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-72392c07-e4e3-4600-9d3d-48beebf0aab2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:33.664929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-72392c07-e4e3-4600-9d3d-48beebf0aab2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1720 microversion: 2.20 time: 0.324011 Aug 24 09:05:33.665479 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 546/1087] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:33 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1720 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:34.690723 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d3db7c79-db0d-4c78-af0f-dc942f870a52 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:34.691418 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d3db7c79-db0d-4c78-af0f-dc942f870a52 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:34.697693 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3db7c79-db0d-4c78-af0f-dc942f870a52 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:34.698178 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3db7c79-db0d-4c78-af0f-dc942f870a52 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:34.698614 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3db7c79-db0d-4c78-af0f-dc942f870a52 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:34.699306 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3db7c79-db0d-4c78-af0f-dc942f870a52 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:34.699766 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3db7c79-db0d-4c78-af0f-dc942f870a52 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:34.700227 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d3db7c79-db0d-4c78-af0f-dc942f870a52 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:34.835647 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d3db7c79-db0d-4c78-af0f-dc942f870a52 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:34.843828 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d3db7c79-db0d-4c78-af0f-dc942f870a52 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:34.845370 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d3db7c79-db0d-4c78-af0f-dc942f870a52 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:34.846529 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d3db7c79-db0d-4c78-af0f-dc942f870a52 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1720 microversion: 2.20 time: 0.161686 Aug 24 09:05:34.847119 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 542/1088] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:34 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:35.420845 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-85d81ec0-49d2-466b-96a8-e74ff98dcc9b req-9a7c27d7-f21a-4d9c-a956-cb042697e03e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05dfbb2-5e47-4ddf-897d-10e19be499ca", "name": "network-vif-unplugged", "status": "completed", "tag": "ca6a6a1a-7c92-4d61-9b26-4ffea23e5485"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:05:35.431131 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-85d81ec0-49d2-466b-96a8-e74ff98dcc9b req-9a7c27d7-f21a-4d9c-a956-cb042697e03e service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:35.431537 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-85d81ec0-49d2-466b-96a8-e74ff98dcc9b req-9a7c27d7-f21a-4d9c-a956-cb042697e03e service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:35.431973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-85d81ec0-49d2-466b-96a8-e74ff98dcc9b req-9a7c27d7-f21a-4d9c-a956-cb042697e03e service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:35.443224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-85d81ec0-49d2-466b-96a8-e74ff98dcc9b req-9a7c27d7-f21a-4d9c-a956-cb042697e03e service nova] Creating event network-vif-unplugged:ca6a6a1a-7c92-4d61-9b26-4ffea23e5485 for instance e05dfbb2-5e47-4ddf-897d-10e19be499ca on hv-cinder-83538 Aug 24 09:05:35.448343 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-85d81ec0-49d2-466b-96a8-e74ff98dcc9b req-9a7c27d7-f21a-4d9c-a956-cb042697e03e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031297 Aug 24 09:05:35.449111 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 547/1089] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:05:35.869329 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a8dac53e-9f82-48f2-bedb-cc8388975550 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:35.869944 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a8dac53e-9f82-48f2-bedb-cc8388975550 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:35.877018 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8dac53e-9f82-48f2-bedb-cc8388975550 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:35.877502 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8dac53e-9f82-48f2-bedb-cc8388975550 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:35.877932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8dac53e-9f82-48f2-bedb-cc8388975550 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:35.878615 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8dac53e-9f82-48f2-bedb-cc8388975550 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:35.879072 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8dac53e-9f82-48f2-bedb-cc8388975550 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:35.879493 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a8dac53e-9f82-48f2-bedb-cc8388975550 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:36.015515 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a8dac53e-9f82-48f2-bedb-cc8388975550 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:36.024422 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a8dac53e-9f82-48f2-bedb-cc8388975550 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:36.025941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a8dac53e-9f82-48f2-bedb-cc8388975550 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:36.027106 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a8dac53e-9f82-48f2-bedb-cc8388975550 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1720 microversion: 2.20 time: 0.161669 Aug 24 09:05:36.027655 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 543/1090] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:35 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:37.051020 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1b7fb343-ce0c-4f85-b254-43c23841067f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:37.051713 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1b7fb343-ce0c-4f85-b254-43c23841067f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:37.057886 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b7fb343-ce0c-4f85-b254-43c23841067f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:37.058370 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b7fb343-ce0c-4f85-b254-43c23841067f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:37.058808 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b7fb343-ce0c-4f85-b254-43c23841067f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:37.059502 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b7fb343-ce0c-4f85-b254-43c23841067f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:37.059978 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b7fb343-ce0c-4f85-b254-43c23841067f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:37.060416 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1b7fb343-ce0c-4f85-b254-43c23841067f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:37.189978 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b7fb343-ce0c-4f85-b254-43c23841067f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:37.198214 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b7fb343-ce0c-4f85-b254-43c23841067f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:37.199754 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1b7fb343-ce0c-4f85-b254-43c23841067f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:37.200940 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1b7fb343-ce0c-4f85-b254-43c23841067f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1663 microversion: 2.20 time: 0.154697 Aug 24 09:05:37.201988 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 548/1091] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:37 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:37.224907 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9031d870-e001-420a-a3a1-84ab2693c7a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9245abac-ddeb-4833-9370-78ce79748f5c"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:05:37.227348 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9031d870-e001-420a-a3a1-84ab2693c7a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:37.234105 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9031d870-e001-420a-a3a1-84ab2693c7a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:37.234599 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9031d870-e001-420a-a3a1-84ab2693c7a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:37.235046 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9031d870-e001-420a-a3a1-84ab2693c7a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:37.235757 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9031d870-e001-420a-a3a1-84ab2693c7a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:37.236254 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9031d870-e001-420a-a3a1-84ab2693c7a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:37.236687 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9031d870-e001-420a-a3a1-84ab2693c7a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:37.530903 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9031d870-e001-420a-a3a1-84ab2693c7a3 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "POST /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.310062 Aug 24 09:05:37.531517 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 544/1092] 10.222.0.67 () {62 vars in 1364 bytes} [Wed Aug 24 09:05:37 2022] POST /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca/os-volume_attachments => generated 188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:05:37.651915 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-482c0a4b-76a7-46eb-97d0-4ac0939608e6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:37.652444 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-482c0a4b-76a7-46eb-97d0-4ac0939608e6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:37.658660 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-482c0a4b-76a7-46eb-97d0-4ac0939608e6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:37.659084 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-482c0a4b-76a7-46eb-97d0-4ac0939608e6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:37.659525 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-482c0a4b-76a7-46eb-97d0-4ac0939608e6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:37.660256 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-482c0a4b-76a7-46eb-97d0-4ac0939608e6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:37.660737 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-482c0a4b-76a7-46eb-97d0-4ac0939608e6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:37.661148 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-482c0a4b-76a7-46eb-97d0-4ac0939608e6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:37.918951 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-482c0a4b-76a7-46eb-97d0-4ac0939608e6 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca/os-volume_attachments/9245abac-ddeb-4833-9370-78ce79748f5c" status: 202 len: 0 microversion: 2.20 time: 0.270853 Aug 24 09:05:37.920393 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 549/1093] 10.222.0.67 () {60 vars in 1457 bytes} [Wed Aug 24 09:05:37 2022] DELETE /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca/os-volume_attachments/9245abac-ddeb-4833-9370-78ce79748f5c => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:05:38.011890 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c638cc60-5ec9-400a-aa29-7ca3843013f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:05:38.012530 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c638cc60-5ec9-400a-aa29-7ca3843013f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:38.019413 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c638cc60-5ec9-400a-aa29-7ca3843013f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:38.019907 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c638cc60-5ec9-400a-aa29-7ca3843013f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:38.020381 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c638cc60-5ec9-400a-aa29-7ca3843013f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:38.021086 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c638cc60-5ec9-400a-aa29-7ca3843013f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:38.021543 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c638cc60-5ec9-400a-aa29-7ca3843013f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:38.021972 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c638cc60-5ec9-400a-aa29-7ca3843013f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:38.051624 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c638cc60-5ec9-400a-aa29-7ca3843013f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120543) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 09:05:38.119015 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c638cc60-5ec9-400a-aa29-7ca3843013f8 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "POST /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca/action" status: 202 len: 0 microversion: 2.20 time: 0.111069 Aug 24 09:05:38.120013 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 545/1094] 10.222.0.67 () {62 vars in 1319 bytes} [Wed Aug 24 09:05:38 2022] POST /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 09:05:38.128640 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cad8dbf5-8e95-4ae1-8e74-9a82239ec2f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:38.129260 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cad8dbf5-8e95-4ae1-8e74-9a82239ec2f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:38.136560 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cad8dbf5-8e95-4ae1-8e74-9a82239ec2f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:38.137049 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cad8dbf5-8e95-4ae1-8e74-9a82239ec2f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:38.137572 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cad8dbf5-8e95-4ae1-8e74-9a82239ec2f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:38.138206 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cad8dbf5-8e95-4ae1-8e74-9a82239ec2f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:38.138721 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cad8dbf5-8e95-4ae1-8e74-9a82239ec2f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:38.139312 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cad8dbf5-8e95-4ae1-8e74-9a82239ec2f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:38.276783 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cad8dbf5-8e95-4ae1-8e74-9a82239ec2f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:38.286252 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cad8dbf5-8e95-4ae1-8e74-9a82239ec2f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:38.287805 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cad8dbf5-8e95-4ae1-8e74-9a82239ec2f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:38.289006 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cad8dbf5-8e95-4ae1-8e74-9a82239ec2f4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1671 microversion: 2.20 time: 0.164277 Aug 24 09:05:38.289563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 550/1095] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:38 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:39.314064 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-63fcbc78-a26b-4bb4-bbd6-ba78812c43db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:39.314677 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-63fcbc78-a26b-4bb4-bbd6-ba78812c43db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:39.320660 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63fcbc78-a26b-4bb4-bbd6-ba78812c43db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:39.321152 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63fcbc78-a26b-4bb4-bbd6-ba78812c43db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:39.321590 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63fcbc78-a26b-4bb4-bbd6-ba78812c43db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:39.322289 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63fcbc78-a26b-4bb4-bbd6-ba78812c43db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:39.322752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63fcbc78-a26b-4bb4-bbd6-ba78812c43db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:39.323181 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-63fcbc78-a26b-4bb4-bbd6-ba78812c43db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:39.327594 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:39.456112 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-63fcbc78-a26b-4bb4-bbd6-ba78812c43db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:39.464675 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-63fcbc78-a26b-4bb4-bbd6-ba78812c43db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:39.466195 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-63fcbc78-a26b-4bb4-bbd6-ba78812c43db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:39.467371 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-63fcbc78-a26b-4bb4-bbd6-ba78812c43db tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.158637 Aug 24 09:05:39.467966 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 546/1096] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:39 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:40.198609 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2036599428", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1984818663", "security_groups": [{"name": "tempest-secgroup-smoke-1880210330"}], "block_device_mapping_v2": [{"uuid": "73699354-ba0c-4ba6-b5b3-64981d4d0d4c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8db512de-7d14-42f9-8a8f-b89724242fee"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:05:40.388907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] validate_networks() for [('8db512de-7d14-42f9-8a8f-b89724242fee', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:05:40.490825 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a62361a1-2820-4526-b119-b9c6c252a15a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:40.491573 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a62361a1-2820-4526-b119-b9c6c252a15a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:40.498663 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a62361a1-2820-4526-b119-b9c6c252a15a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:40.499150 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a62361a1-2820-4526-b119-b9c6c252a15a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:40.499588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a62361a1-2820-4526-b119-b9c6c252a15a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:40.500332 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a62361a1-2820-4526-b119-b9c6c252a15a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:40.500789 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a62361a1-2820-4526-b119-b9c6c252a15a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:40.501213 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a62361a1-2820-4526-b119-b9c6c252a15a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:40.744368 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a62361a1-2820-4526-b119-b9c6c252a15a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:40.757194 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a62361a1-2820-4526-b119-b9c6c252a15a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:40.758787 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a62361a1-2820-4526-b119-b9c6c252a15a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:40.760058 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a62361a1-2820-4526-b119-b9c6c252a15a tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.273180 Aug 24 09:05:40.760656 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 547/1097] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:40 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:40.952358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:05:40.952358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:05:40.952358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:05:40.952358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:05:40.952358 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:05:40.967515 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fa2d32cc-54e5-402a-a8b4-da35a9d1b3f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:40.968452 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fa2d32cc-54e5-402a-a8b4-da35a9d1b3f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:40.977533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa2d32cc-54e5-402a-a8b4-da35a9d1b3f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:40.978113 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa2d32cc-54e5-402a-a8b4-da35a9d1b3f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:40.978638 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa2d32cc-54e5-402a-a8b4-da35a9d1b3f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:40.980300 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa2d32cc-54e5-402a-a8b4-da35a9d1b3f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:40.980785 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:40.981471 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa2d32cc-54e5-402a-a8b4-da35a9d1b3f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:40.981961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fa2d32cc-54e5-402a-a8b4-da35a9d1b3f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:40.982092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:40.988852 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:40.989833 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:40.990419 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:40.990959 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:41.011197 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Getting quotas for project 080318594f144fa3852577bc02ee5357. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:05:41.015832 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Getting quotas for user 46b3aa99a5e84ef2a8df193628feb0d6 and project 080318594f144fa3852577bc02ee5357. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:05:41.016346 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fa2d32cc-54e5-402a-a8b4-da35a9d1b3f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:05:41.083882 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:05:41.086241 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='73699354-ba0c-4ba6-b5b3-64981d4d0d4c',volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:05:41.170493 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fa2d32cc-54e5-402a-a8b4-da35a9d1b3f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 204 len: 0 microversion: 2.1 time: 0.209679 Aug 24 09:05:41.171524 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 548/1098] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:05:40 2022] DELETE /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:05:41.182118 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-bb198bae-a836-4b23-a179-38d7e0cb57c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:41.185923 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-bb198bae-a836-4b23-a179-38d7e0cb57c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:41.199049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb198bae-a836-4b23-a179-38d7e0cb57c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:41.200263 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb198bae-a836-4b23-a179-38d7e0cb57c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:41.200865 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb198bae-a836-4b23-a179-38d7e0cb57c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:41.202276 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb198bae-a836-4b23-a179-38d7e0cb57c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:41.202960 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb198bae-a836-4b23-a179-38d7e0cb57c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:41.203660 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-bb198bae-a836-4b23-a179-38d7e0cb57c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:41.299671 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-887b2ac9-4510-4402-976b-7103227f64ac tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.104994 Aug 24 09:05:41.301074 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 551/1099] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 09:05:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 09:05:41.314364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-482f0c77-3ea5-4c4b-bbd8-7afc748d6072 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:41.315403 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-482f0c77-3ea5-4c4b-bbd8-7afc748d6072 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:41.403578 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-482f0c77-3ea5-4c4b-bbd8-7afc748d6072 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:41.411139 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-482f0c77-3ea5-4c4b-bbd8-7afc748d6072 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1095 microversion: 2.1 time: 0.102546 Aug 24 09:05:41.411816 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 552/1100] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:41 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1095 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:41.454139 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-bb198bae-a836-4b23-a179-38d7e0cb57c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:41.462383 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-bb198bae-a836-4b23-a179-38d7e0cb57c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.286078 Aug 24 09:05:41.462972 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 549/1101] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:41 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:41.784599 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e9adf6dc-382f-4248-88f5-d7d98c2e0cc4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:41.785349 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e9adf6dc-382f-4248-88f5-d7d98c2e0cc4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:41.795605 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9adf6dc-382f-4248-88f5-d7d98c2e0cc4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:41.796129 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9adf6dc-382f-4248-88f5-d7d98c2e0cc4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:41.796699 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9adf6dc-382f-4248-88f5-d7d98c2e0cc4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:41.797412 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9adf6dc-382f-4248-88f5-d7d98c2e0cc4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:41.797910 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9adf6dc-382f-4248-88f5-d7d98c2e0cc4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:41.798337 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e9adf6dc-382f-4248-88f5-d7d98c2e0cc4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:41.931126 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e813f90c-2a81-45f6-9f82-e6818bfe772a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:41.931696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e813f90c-2a81-45f6-9f82-e6818bfe772a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:41.934997 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e9adf6dc-382f-4248-88f5-d7d98c2e0cc4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:41.938869 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e813f90c-2a81-45f6-9f82-e6818bfe772a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:41.939363 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e813f90c-2a81-45f6-9f82-e6818bfe772a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:41.939800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e813f90c-2a81-45f6-9f82-e6818bfe772a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:41.940531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e813f90c-2a81-45f6-9f82-e6818bfe772a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:41.940998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e813f90c-2a81-45f6-9f82-e6818bfe772a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:41.941425 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e813f90c-2a81-45f6-9f82-e6818bfe772a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:41.944177 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e9adf6dc-382f-4248-88f5-d7d98c2e0cc4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:41.945740 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e9adf6dc-382f-4248-88f5-d7d98c2e0cc4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:41.946950 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e9adf6dc-382f-4248-88f5-d7d98c2e0cc4 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.167515 Aug 24 09:05:41.947510 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 553/1102] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:41 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:41.965223 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e813f90c-2a81-45f6-9f82-e6818bfe772a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/ips" status: 200 len: 146 microversion: 2.1 time: 0.037918 Aug 24 09:05:41.965932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 550/1103] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 24 09:05:41 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:05:42.432526 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-91bd191f-5297-4f0a-b960-d31ce29d3b9d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:42.434524 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-91bd191f-5297-4f0a-b960-d31ce29d3b9d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:42.442196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91bd191f-5297-4f0a-b960-d31ce29d3b9d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:42.442691 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91bd191f-5297-4f0a-b960-d31ce29d3b9d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:42.443124 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91bd191f-5297-4f0a-b960-d31ce29d3b9d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:42.443830 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91bd191f-5297-4f0a-b960-d31ce29d3b9d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:42.444434 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91bd191f-5297-4f0a-b960-d31ce29d3b9d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:42.444864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-91bd191f-5297-4f0a-b960-d31ce29d3b9d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:42.483679 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0928d8af-c7af-4658-8bb4-2f4326a3a4f2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:42.484491 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0928d8af-c7af-4658-8bb4-2f4326a3a4f2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:42.490724 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0928d8af-c7af-4658-8bb4-2f4326a3a4f2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:42.491215 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0928d8af-c7af-4658-8bb4-2f4326a3a4f2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:42.491645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0928d8af-c7af-4658-8bb4-2f4326a3a4f2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:42.492363 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0928d8af-c7af-4658-8bb4-2f4326a3a4f2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:42.492818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0928d8af-c7af-4658-8bb4-2f4326a3a4f2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:42.493241 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0928d8af-c7af-4658-8bb4-2f4326a3a4f2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:42.508836 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-91bd191f-5297-4f0a-b960-d31ce29d3b9d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:42.516881 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-91bd191f-5297-4f0a-b960-d31ce29d3b9d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1145 microversion: 2.1 time: 0.088301 Aug 24 09:05:42.517464 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 554/1104] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:42 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:42.626066 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0928d8af-c7af-4658-8bb4-2f4326a3a4f2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:42.638318 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0928d8af-c7af-4658-8bb4-2f4326a3a4f2 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.159153 Aug 24 09:05:42.639321 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 551/1105] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:42 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:42.970557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c9bae77e-87eb-4ed4-afac-0e3ddf4c8022 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:42.971176 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c9bae77e-87eb-4ed4-afac-0e3ddf4c8022 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:42.977166 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9bae77e-87eb-4ed4-afac-0e3ddf4c8022 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:42.977652 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9bae77e-87eb-4ed4-afac-0e3ddf4c8022 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:42.978092 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9bae77e-87eb-4ed4-afac-0e3ddf4c8022 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:42.978791 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9bae77e-87eb-4ed4-afac-0e3ddf4c8022 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:42.979250 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9bae77e-87eb-4ed4-afac-0e3ddf4c8022 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:42.979682 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c9bae77e-87eb-4ed4-afac-0e3ddf4c8022 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:43.122596 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c9bae77e-87eb-4ed4-afac-0e3ddf4c8022 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:43.131180 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c9bae77e-87eb-4ed4-afac-0e3ddf4c8022 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:43.132750 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c9bae77e-87eb-4ed4-afac-0e3ddf4c8022 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:43.133928 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c9bae77e-87eb-4ed4-afac-0e3ddf4c8022 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.167281 Aug 24 09:05:43.134611 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 555/1106] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:42 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:43.298249 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4ae788e2-6767-474a-ba1e-1915a9caf234 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b608db67-e215-4567-8d0b-dbf95c099028"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:05:43.300784 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4ae788e2-6767-474a-ba1e-1915a9caf234 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:43.307404 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ae788e2-6767-474a-ba1e-1915a9caf234 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:43.307895 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ae788e2-6767-474a-ba1e-1915a9caf234 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:43.309795 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ae788e2-6767-474a-ba1e-1915a9caf234 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:43.310453 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ae788e2-6767-474a-ba1e-1915a9caf234 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:43.310924 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ae788e2-6767-474a-ba1e-1915a9caf234 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:43.311357 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4ae788e2-6767-474a-ba1e-1915a9caf234 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:43.538316 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0032e41c-ec3c-471b-a61c-7184b66afa3e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:43.538929 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0032e41c-ec3c-471b-a61c-7184b66afa3e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:43.545629 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0032e41c-ec3c-471b-a61c-7184b66afa3e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:43.546116 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0032e41c-ec3c-471b-a61c-7184b66afa3e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:43.546557 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0032e41c-ec3c-471b-a61c-7184b66afa3e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:43.547258 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0032e41c-ec3c-471b-a61c-7184b66afa3e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:43.547719 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0032e41c-ec3c-471b-a61c-7184b66afa3e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:43.548185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0032e41c-ec3c-471b-a61c-7184b66afa3e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:43.613977 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0032e41c-ec3c-471b-a61c-7184b66afa3e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:43.622520 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0032e41c-ec3c-471b-a61c-7184b66afa3e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1145 microversion: 2.1 time: 0.088126 Aug 24 09:05:43.623109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 556/1107] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:43 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:43.660883 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-476b0c6e-50ff-48b5-b926-b755189940ce tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:43.661492 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-476b0c6e-50ff-48b5-b926-b755189940ce tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:43.668347 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-476b0c6e-50ff-48b5-b926-b755189940ce tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:43.668839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-476b0c6e-50ff-48b5-b926-b755189940ce tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:43.669277 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-476b0c6e-50ff-48b5-b926-b755189940ce tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:43.669985 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-476b0c6e-50ff-48b5-b926-b755189940ce tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:43.670491 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-476b0c6e-50ff-48b5-b926-b755189940ce tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:43.670880 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-476b0c6e-50ff-48b5-b926-b755189940ce tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:43.824599 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-476b0c6e-50ff-48b5-b926-b755189940ce tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:43.832780 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-476b0c6e-50ff-48b5-b926-b755189940ce tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.175726 Aug 24 09:05:43.833357 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 557/1108] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:43 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:44.158234 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-aafcbea2-914c-4ff6-ba69-e3988ccaca72 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:44.159188 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-aafcbea2-914c-4ff6-ba69-e3988ccaca72 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:44.168240 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aafcbea2-914c-4ff6-ba69-e3988ccaca72 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:44.168904 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aafcbea2-914c-4ff6-ba69-e3988ccaca72 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:44.169192 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aafcbea2-914c-4ff6-ba69-e3988ccaca72 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:44.170063 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aafcbea2-914c-4ff6-ba69-e3988ccaca72 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:44.170527 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aafcbea2-914c-4ff6-ba69-e3988ccaca72 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:44.170971 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-aafcbea2-914c-4ff6-ba69-e3988ccaca72 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:44.331603 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-aafcbea2-914c-4ff6-ba69-e3988ccaca72 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:44.341134 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-aafcbea2-914c-4ff6-ba69-e3988ccaca72 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:44.342667 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-aafcbea2-914c-4ff6-ba69-e3988ccaca72 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:44.343850 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-aafcbea2-914c-4ff6-ba69-e3988ccaca72 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.189727 Aug 24 09:05:44.344674 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 558/1109] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:44 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:44.642916 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3da17af5-2e31-438b-bd6e-434c2b7fd313 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:44.643599 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3da17af5-2e31-438b-bd6e-434c2b7fd313 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:44.650081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da17af5-2e31-438b-bd6e-434c2b7fd313 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:44.650836 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da17af5-2e31-438b-bd6e-434c2b7fd313 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:44.651942 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da17af5-2e31-438b-bd6e-434c2b7fd313 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:44.652795 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da17af5-2e31-438b-bd6e-434c2b7fd313 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:44.653256 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da17af5-2e31-438b-bd6e-434c2b7fd313 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:44.653790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3da17af5-2e31-438b-bd6e-434c2b7fd313 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:44.717044 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3da17af5-2e31-438b-bd6e-434c2b7fd313 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:44.727224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3da17af5-2e31-438b-bd6e-434c2b7fd313 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1145 microversion: 2.1 time: 0.087889 Aug 24 09:05:44.728141 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 559/1110] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:44 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:44.853733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5cd082f7-c21e-4ef7-bd12-d8402cd30b74 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:44.854551 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5cd082f7-c21e-4ef7-bd12-d8402cd30b74 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:44.860643 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cd082f7-c21e-4ef7-bd12-d8402cd30b74 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:44.861137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cd082f7-c21e-4ef7-bd12-d8402cd30b74 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:44.861579 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cd082f7-c21e-4ef7-bd12-d8402cd30b74 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:44.862284 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cd082f7-c21e-4ef7-bd12-d8402cd30b74 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:44.862778 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cd082f7-c21e-4ef7-bd12-d8402cd30b74 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:44.863204 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5cd082f7-c21e-4ef7-bd12-d8402cd30b74 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:45.008284 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5cd082f7-c21e-4ef7-bd12-d8402cd30b74 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:45.018235 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5cd082f7-c21e-4ef7-bd12-d8402cd30b74 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.168205 Aug 24 09:05:45.028171 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 560/1111] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:44 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:45.366899 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-21728410-25b2-4dae-ad66-844937bd5e9b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:45.367436 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-21728410-25b2-4dae-ad66-844937bd5e9b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:45.374529 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21728410-25b2-4dae-ad66-844937bd5e9b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:45.375030 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21728410-25b2-4dae-ad66-844937bd5e9b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:45.375475 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21728410-25b2-4dae-ad66-844937bd5e9b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:45.376229 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21728410-25b2-4dae-ad66-844937bd5e9b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:45.376695 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21728410-25b2-4dae-ad66-844937bd5e9b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:45.377130 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-21728410-25b2-4dae-ad66-844937bd5e9b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:45.521470 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-21728410-25b2-4dae-ad66-844937bd5e9b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:45.526997 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:45.535724 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-21728410-25b2-4dae-ad66-844937bd5e9b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:45.537384 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-21728410-25b2-4dae-ad66-844937bd5e9b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:45.538574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-21728410-25b2-4dae-ad66-844937bd5e9b tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.175739 Aug 24 09:05:45.539451 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 561/1112] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:45 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:45.749530 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fd477e40-bede-467e-b448-6bcbbc0ae3c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:45.750152 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fd477e40-bede-467e-b448-6bcbbc0ae3c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:45.757741 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd477e40-bede-467e-b448-6bcbbc0ae3c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:45.758227 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd477e40-bede-467e-b448-6bcbbc0ae3c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:45.758666 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd477e40-bede-467e-b448-6bcbbc0ae3c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:45.759364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd477e40-bede-467e-b448-6bcbbc0ae3c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:45.759822 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd477e40-bede-467e-b448-6bcbbc0ae3c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:45.760356 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fd477e40-bede-467e-b448-6bcbbc0ae3c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:45.828169 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-fd477e40-bede-467e-b448-6bcbbc0ae3c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:45.837802 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fd477e40-bede-467e-b448-6bcbbc0ae3c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1145 microversion: 2.1 time: 0.092161 Aug 24 09:05:45.838944 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 562/1113] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:45 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:46.041592 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6cef427c-b06a-4110-b582-d5d2efdcd9a4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:46.042359 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6cef427c-b06a-4110-b582-d5d2efdcd9a4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:46.048322 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cef427c-b06a-4110-b582-d5d2efdcd9a4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:46.048812 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cef427c-b06a-4110-b582-d5d2efdcd9a4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:46.049252 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cef427c-b06a-4110-b582-d5d2efdcd9a4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:46.049943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cef427c-b06a-4110-b582-d5d2efdcd9a4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:46.050405 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cef427c-b06a-4110-b582-d5d2efdcd9a4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:46.050836 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6cef427c-b06a-4110-b582-d5d2efdcd9a4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:46.210082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6cef427c-b06a-4110-b582-d5d2efdcd9a4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:46.220699 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6cef427c-b06a-4110-b582-d5d2efdcd9a4 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.183313 Aug 24 09:05:46.221500 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 563/1114] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:46 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:46.722569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8c27c6ae-a5f1-4acf-9ffe-6bb9d765fead tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:46.723364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8c27c6ae-a5f1-4acf-9ffe-6bb9d765fead tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:46.732729 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c27c6ae-a5f1-4acf-9ffe-6bb9d765fead tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:46.733235 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c27c6ae-a5f1-4acf-9ffe-6bb9d765fead tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:46.733670 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c27c6ae-a5f1-4acf-9ffe-6bb9d765fead tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:46.734839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c27c6ae-a5f1-4acf-9ffe-6bb9d765fead tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:46.735322 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c27c6ae-a5f1-4acf-9ffe-6bb9d765fead tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:46.735882 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c27c6ae-a5f1-4acf-9ffe-6bb9d765fead tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:46.879829 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8c27c6ae-a5f1-4acf-9ffe-6bb9d765fead tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:46.888830 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8c27c6ae-a5f1-4acf-9ffe-6bb9d765fead tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:46.890349 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8c27c6ae-a5f1-4acf-9ffe-6bb9d765fead tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:46.891515 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8c27c6ae-a5f1-4acf-9ffe-6bb9d765fead tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.331663 Aug 24 09:05:46.904346 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 564/1115] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:46 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:46.909937 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-25880eb2-f7e1-4541-9b86-de1b74d98af9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:46.910559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-25880eb2-f7e1-4541-9b86-de1b74d98af9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:46.917667 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25880eb2-f7e1-4541-9b86-de1b74d98af9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:46.918147 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25880eb2-f7e1-4541-9b86-de1b74d98af9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:46.918585 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25880eb2-f7e1-4541-9b86-de1b74d98af9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:46.919278 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25880eb2-f7e1-4541-9b86-de1b74d98af9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:46.919728 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25880eb2-f7e1-4541-9b86-de1b74d98af9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:46.920170 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25880eb2-f7e1-4541-9b86-de1b74d98af9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:46.985127 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-25880eb2-f7e1-4541-9b86-de1b74d98af9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:46.993086 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-25880eb2-f7e1-4541-9b86-de1b74d98af9 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1145 microversion: 2.1 time: 0.087566 Aug 24 09:05:46.993857 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 565/1116] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:46 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:47.241830 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5e4d0ed6-ce7a-4a8d-a1d0-f7a14db4e5a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:47.242538 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5e4d0ed6-ce7a-4a8d-a1d0-f7a14db4e5a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:47.248769 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e4d0ed6-ce7a-4a8d-a1d0-f7a14db4e5a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:47.249260 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e4d0ed6-ce7a-4a8d-a1d0-f7a14db4e5a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:47.249730 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e4d0ed6-ce7a-4a8d-a1d0-f7a14db4e5a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:47.250437 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e4d0ed6-ce7a-4a8d-a1d0-f7a14db4e5a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:47.250899 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e4d0ed6-ce7a-4a8d-a1d0-f7a14db4e5a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:47.251324 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5e4d0ed6-ce7a-4a8d-a1d0-f7a14db4e5a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:47.397428 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5e4d0ed6-ce7a-4a8d-a1d0-f7a14db4e5a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:47.409262 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5e4d0ed6-ce7a-4a8d-a1d0-f7a14db4e5a9 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.171391 Aug 24 09:05:47.409984 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 566/1117] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:47 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:47.918758 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-312d2783-1711-47b5-94f8-44c2a70e7dbf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:47.919497 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-312d2783-1711-47b5-94f8-44c2a70e7dbf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:47.925912 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-312d2783-1711-47b5-94f8-44c2a70e7dbf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:47.926397 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-312d2783-1711-47b5-94f8-44c2a70e7dbf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:47.926831 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-312d2783-1711-47b5-94f8-44c2a70e7dbf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:47.927525 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-312d2783-1711-47b5-94f8-44c2a70e7dbf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:47.927983 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-312d2783-1711-47b5-94f8-44c2a70e7dbf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:47.928446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-312d2783-1711-47b5-94f8-44c2a70e7dbf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:48.071474 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-312d2783-1711-47b5-94f8-44c2a70e7dbf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:48.083400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-312d2783-1711-47b5-94f8-44c2a70e7dbf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:48.085166 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-312d2783-1711-47b5-94f8-44c2a70e7dbf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:48.086368 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-312d2783-1711-47b5-94f8-44c2a70e7dbf tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.171553 Aug 24 09:05:48.087376 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 567/1118] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:47 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:48.092326 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f33a1f9b-5b15-4edd-8a5e-3f301a114a65 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:48.092892 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f33a1f9b-5b15-4edd-8a5e-3f301a114a65 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:48.107256 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f33a1f9b-5b15-4edd-8a5e-3f301a114a65 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:48.107759 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f33a1f9b-5b15-4edd-8a5e-3f301a114a65 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:48.108233 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f33a1f9b-5b15-4edd-8a5e-3f301a114a65 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:48.108950 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f33a1f9b-5b15-4edd-8a5e-3f301a114a65 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:48.109406 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f33a1f9b-5b15-4edd-8a5e-3f301a114a65 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:48.109832 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f33a1f9b-5b15-4edd-8a5e-3f301a114a65 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:48.173854 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f33a1f9b-5b15-4edd-8a5e-3f301a114a65 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:48.183502 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f33a1f9b-5b15-4edd-8a5e-3f301a114a65 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1145 microversion: 2.1 time: 0.094852 Aug 24 09:05:48.184291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 568/1119] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:48 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:48.430223 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2a6bbbae-2014-4c4e-a939-45f6773f6454 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:48.431701 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2a6bbbae-2014-4c4e-a939-45f6773f6454 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:48.440700 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a6bbbae-2014-4c4e-a939-45f6773f6454 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:48.441199 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a6bbbae-2014-4c4e-a939-45f6773f6454 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:48.441640 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a6bbbae-2014-4c4e-a939-45f6773f6454 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:48.442546 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a6bbbae-2014-4c4e-a939-45f6773f6454 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:48.443007 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a6bbbae-2014-4c4e-a939-45f6773f6454 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:48.443467 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a6bbbae-2014-4c4e-a939-45f6773f6454 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:48.590437 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2a6bbbae-2014-4c4e-a939-45f6773f6454 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:48.598273 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2a6bbbae-2014-4c4e-a939-45f6773f6454 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.172028 Aug 24 09:05:48.598837 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 569/1120] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:48 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:49.109648 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a9cdcb35-9c57-4550-a3e9-38bfb31a743e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:49.111130 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a9cdcb35-9c57-4550-a3e9-38bfb31a743e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:49.117574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9cdcb35-9c57-4550-a3e9-38bfb31a743e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:49.118093 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9cdcb35-9c57-4550-a3e9-38bfb31a743e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:49.118531 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9cdcb35-9c57-4550-a3e9-38bfb31a743e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:49.119329 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9cdcb35-9c57-4550-a3e9-38bfb31a743e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:49.119785 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9cdcb35-9c57-4550-a3e9-38bfb31a743e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:49.120233 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a9cdcb35-9c57-4550-a3e9-38bfb31a743e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:49.261422 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9cdcb35-9c57-4550-a3e9-38bfb31a743e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:49.270109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9cdcb35-9c57-4550-a3e9-38bfb31a743e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:49.271695 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a9cdcb35-9c57-4550-a3e9-38bfb31a743e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:49.272926 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a9cdcb35-9c57-4550-a3e9-38bfb31a743e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.167180 Aug 24 09:05:49.273484 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 570/1121] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:49 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:49.279582 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-563aeefe-589e-49bd-b661-8894b34f177c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:49.280345 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-563aeefe-589e-49bd-b661-8894b34f177c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:49.287737 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-563aeefe-589e-49bd-b661-8894b34f177c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:49.288350 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-563aeefe-589e-49bd-b661-8894b34f177c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:49.289023 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-563aeefe-589e-49bd-b661-8894b34f177c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:49.289747 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-563aeefe-589e-49bd-b661-8894b34f177c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:49.290328 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-563aeefe-589e-49bd-b661-8894b34f177c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:49.290643 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-563aeefe-589e-49bd-b661-8894b34f177c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:49.361709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-563aeefe-589e-49bd-b661-8894b34f177c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:49.370206 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-563aeefe-589e-49bd-b661-8894b34f177c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1145 microversion: 2.1 time: 0.094994 Aug 24 09:05:49.370770 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 571/1122] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:49 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1145 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:49.620663 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f32f0e0c-33aa-4966-a4b8-1bfc99c3c128 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:49.621231 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f32f0e0c-33aa-4966-a4b8-1bfc99c3c128 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:49.627218 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f32f0e0c-33aa-4966-a4b8-1bfc99c3c128 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:49.627707 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f32f0e0c-33aa-4966-a4b8-1bfc99c3c128 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:49.628176 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f32f0e0c-33aa-4966-a4b8-1bfc99c3c128 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:49.628873 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f32f0e0c-33aa-4966-a4b8-1bfc99c3c128 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:49.629337 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f32f0e0c-33aa-4966-a4b8-1bfc99c3c128 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:49.629764 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f32f0e0c-33aa-4966-a4b8-1bfc99c3c128 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:49.775568 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f32f0e0c-33aa-4966-a4b8-1bfc99c3c128 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:49.784678 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f32f0e0c-33aa-4966-a4b8-1bfc99c3c128 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.168694 Aug 24 09:05:49.785651 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 572/1123] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:49 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:50.300948 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-549c0983-9826-4535-b49d-d5860717f438 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:50.302885 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-549c0983-9826-4535-b49d-d5860717f438 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:50.312206 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-549c0983-9826-4535-b49d-d5860717f438 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:50.312709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-549c0983-9826-4535-b49d-d5860717f438 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:50.313162 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-549c0983-9826-4535-b49d-d5860717f438 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:50.313877 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-549c0983-9826-4535-b49d-d5860717f438 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:50.314337 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-549c0983-9826-4535-b49d-d5860717f438 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:50.314768 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-549c0983-9826-4535-b49d-d5860717f438 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:50.496136 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-549c0983-9826-4535-b49d-d5860717f438 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:50.505211 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-549c0983-9826-4535-b49d-d5860717f438 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:50.506867 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-549c0983-9826-4535-b49d-d5860717f438 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:50.509104 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-549c0983-9826-4535-b49d-d5860717f438 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.213681 Aug 24 09:05:50.509784 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 573/1124] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:50 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:50.515870 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7d941589-5e94-4378-8b9f-15f738c5d552 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:50.516584 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7d941589-5e94-4378-8b9f-15f738c5d552 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:50.522654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d941589-5e94-4378-8b9f-15f738c5d552 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:50.523780 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d941589-5e94-4378-8b9f-15f738c5d552 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:50.525067 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d941589-5e94-4378-8b9f-15f738c5d552 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:50.526472 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d941589-5e94-4378-8b9f-15f738c5d552 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:50.526770 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d941589-5e94-4378-8b9f-15f738c5d552 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:50.527337 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d941589-5e94-4378-8b9f-15f738c5d552 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:50.610072 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7d941589-5e94-4378-8b9f-15f738c5d552 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:50.623275 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7d941589-5e94-4378-8b9f-15f738c5d552 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1145 microversion: 2.1 time: 0.112395 Aug 24 09:05:50.623868 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 574/1125] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:50 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1145 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:50.809328 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3325200b-bc88-485c-8732-185d33e776a5 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:50.811507 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3325200b-bc88-485c-8732-185d33e776a5 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:50.820648 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3325200b-bc88-485c-8732-185d33e776a5 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:50.821731 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3325200b-bc88-485c-8732-185d33e776a5 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:50.822224 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3325200b-bc88-485c-8732-185d33e776a5 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:50.822998 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3325200b-bc88-485c-8732-185d33e776a5 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:50.823463 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3325200b-bc88-485c-8732-185d33e776a5 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:50.823888 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3325200b-bc88-485c-8732-185d33e776a5 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:50.977818 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3325200b-bc88-485c-8732-185d33e776a5 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:50.985658 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3325200b-bc88-485c-8732-185d33e776a5 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.180755 Aug 24 09:05:50.986230 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 575/1126] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:50 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:51.534102 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-037862a2-cb46-4112-a072-78c6e573adfe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:51.534857 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-037862a2-cb46-4112-a072-78c6e573adfe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:51.536830 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:51.538018 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=8 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:51.545348 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037862a2-cb46-4112-a072-78c6e573adfe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:51.545846 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037862a2-cb46-4112-a072-78c6e573adfe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:51.546287 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037862a2-cb46-4112-a072-78c6e573adfe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:51.547001 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037862a2-cb46-4112-a072-78c6e573adfe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:51.547462 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037862a2-cb46-4112-a072-78c6e573adfe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:51.547895 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-037862a2-cb46-4112-a072-78c6e573adfe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:51.687997 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-037862a2-cb46-4112-a072-78c6e573adfe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:51.696352 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-037862a2-cb46-4112-a072-78c6e573adfe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:51.697873 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-037862a2-cb46-4112-a072-78c6e573adfe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:51.699038 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-037862a2-cb46-4112-a072-78c6e573adfe tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.169587 Aug 24 09:05:51.699595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 576/1127] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:51 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:51.704129 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9466cd1f-371a-446b-96fb-96ff8db78c3b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:51.704675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9466cd1f-371a-446b-96fb-96ff8db78c3b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:51.710495 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9466cd1f-371a-446b-96fb-96ff8db78c3b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:51.711492 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9466cd1f-371a-446b-96fb-96ff8db78c3b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:51.711934 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9466cd1f-371a-446b-96fb-96ff8db78c3b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:51.712660 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9466cd1f-371a-446b-96fb-96ff8db78c3b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:51.713127 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9466cd1f-371a-446b-96fb-96ff8db78c3b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:51.713553 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9466cd1f-371a-446b-96fb-96ff8db78c3b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:51.780845 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9466cd1f-371a-446b-96fb-96ff8db78c3b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:51.788538 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9466cd1f-371a-446b-96fb-96ff8db78c3b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1145 microversion: 2.1 time: 0.087943 Aug 24 09:05:51.789736 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 577/1128] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:51 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:52.007534 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6639a312-9c86-4262-86fa-7678994d474b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:52.008686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6639a312-9c86-4262-86fa-7678994d474b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:52.014687 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6639a312-9c86-4262-86fa-7678994d474b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:52.015169 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6639a312-9c86-4262-86fa-7678994d474b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:52.015612 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6639a312-9c86-4262-86fa-7678994d474b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:52.016344 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6639a312-9c86-4262-86fa-7678994d474b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:52.016801 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6639a312-9c86-4262-86fa-7678994d474b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:52.017228 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6639a312-9c86-4262-86fa-7678994d474b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:52.037711 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:52.151073 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6639a312-9c86-4262-86fa-7678994d474b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:52.159185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6639a312-9c86-4262-86fa-7678994d474b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.155613 Aug 24 09:05:52.160445 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 578/1129] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:52 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:52.722458 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e0ff709d-7ded-4410-acbd-15464d3a7c26 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:52.723140 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e0ff709d-7ded-4410-acbd-15464d3a7c26 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:52.730168 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0ff709d-7ded-4410-acbd-15464d3a7c26 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:52.730656 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0ff709d-7ded-4410-acbd-15464d3a7c26 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:52.731094 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0ff709d-7ded-4410-acbd-15464d3a7c26 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:52.731800 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0ff709d-7ded-4410-acbd-15464d3a7c26 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:52.732289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0ff709d-7ded-4410-acbd-15464d3a7c26 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:52.732718 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e0ff709d-7ded-4410-acbd-15464d3a7c26 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:52.862371 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e0ff709d-7ded-4410-acbd-15464d3a7c26 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:52.871147 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e0ff709d-7ded-4410-acbd-15464d3a7c26 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:52.872665 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e0ff709d-7ded-4410-acbd-15464d3a7c26 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:52.873813 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e0ff709d-7ded-4410-acbd-15464d3a7c26 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.155340 Aug 24 09:05:52.874373 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 579/1130] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:52 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:52.878654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d85ddae6-db91-466b-bebc-6e966511187a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:52.879244 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d85ddae6-db91-466b-bebc-6e966511187a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:52.884938 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d85ddae6-db91-466b-bebc-6e966511187a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:52.885410 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d85ddae6-db91-466b-bebc-6e966511187a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:52.885840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d85ddae6-db91-466b-bebc-6e966511187a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:52.886517 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d85ddae6-db91-466b-bebc-6e966511187a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:52.886969 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d85ddae6-db91-466b-bebc-6e966511187a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:52.887386 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d85ddae6-db91-466b-bebc-6e966511187a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:52.952390 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d85ddae6-db91-466b-bebc-6e966511187a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:52.959972 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d85ddae6-db91-466b-bebc-6e966511187a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1145 microversion: 2.1 time: 0.084664 Aug 24 09:05:52.960553 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 580/1131] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:52 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:53.180788 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0623aebb-e647-409e-88d6-97ab2dc3f2fe tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:53.181521 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0623aebb-e647-409e-88d6-97ab2dc3f2fe tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:53.187458 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0623aebb-e647-409e-88d6-97ab2dc3f2fe tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:53.187949 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0623aebb-e647-409e-88d6-97ab2dc3f2fe tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:53.188420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0623aebb-e647-409e-88d6-97ab2dc3f2fe tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:53.189116 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0623aebb-e647-409e-88d6-97ab2dc3f2fe tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:53.189574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0623aebb-e647-409e-88d6-97ab2dc3f2fe tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:53.190000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0623aebb-e647-409e-88d6-97ab2dc3f2fe tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:53.307191 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:53.324010 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-0623aebb-e647-409e-88d6-97ab2dc3f2fe tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:53.331742 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0623aebb-e647-409e-88d6-97ab2dc3f2fe tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.155526 Aug 24 09:05:53.332333 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 581/1132] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:53 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:53.387902 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:53.897038 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dc64b139-d5cd-4cf1-906b-a6239b656a1e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:53.897646 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dc64b139-d5cd-4cf1-906b-a6239b656a1e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:53.904852 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc64b139-d5cd-4cf1-906b-a6239b656a1e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:53.905336 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc64b139-d5cd-4cf1-906b-a6239b656a1e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:53.905768 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc64b139-d5cd-4cf1-906b-a6239b656a1e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:53.906458 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc64b139-d5cd-4cf1-906b-a6239b656a1e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:53.906911 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc64b139-d5cd-4cf1-906b-a6239b656a1e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:53.907332 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dc64b139-d5cd-4cf1-906b-a6239b656a1e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:54.036948 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-dc64b139-d5cd-4cf1-906b-a6239b656a1e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:54.045799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-dc64b139-d5cd-4cf1-906b-a6239b656a1e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:54.047308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-dc64b139-d5cd-4cf1-906b-a6239b656a1e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:54.048493 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dc64b139-d5cd-4cf1-906b-a6239b656a1e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.155624 Aug 24 09:05:54.049046 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 582/1133] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:53 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:54.053365 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9cf765bc-6aba-428a-8b5a-d4a9f84a062c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:54.053970 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9cf765bc-6aba-428a-8b5a-d4a9f84a062c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:54.059490 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf765bc-6aba-428a-8b5a-d4a9f84a062c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:54.059975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf765bc-6aba-428a-8b5a-d4a9f84a062c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:54.060451 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf765bc-6aba-428a-8b5a-d4a9f84a062c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:54.061140 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf765bc-6aba-428a-8b5a-d4a9f84a062c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:54.061598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf765bc-6aba-428a-8b5a-d4a9f84a062c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:54.062019 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9cf765bc-6aba-428a-8b5a-d4a9f84a062c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:54.127133 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9cf765bc-6aba-428a-8b5a-d4a9f84a062c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:54.135440 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9cf765bc-6aba-428a-8b5a-d4a9f84a062c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1145 microversion: 2.1 time: 0.085418 Aug 24 09:05:54.136019 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 583/1134] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:54 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:54.352777 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6b1766e9-9fcf-4535-9f08-0bb8d67ba494 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:54.353409 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6b1766e9-9fcf-4535-9f08-0bb8d67ba494 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:54.359552 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b1766e9-9fcf-4535-9f08-0bb8d67ba494 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:54.359975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b1766e9-9fcf-4535-9f08-0bb8d67ba494 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:54.360546 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b1766e9-9fcf-4535-9f08-0bb8d67ba494 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:54.361210 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b1766e9-9fcf-4535-9f08-0bb8d67ba494 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:54.361738 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b1766e9-9fcf-4535-9f08-0bb8d67ba494 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:54.362099 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6b1766e9-9fcf-4535-9f08-0bb8d67ba494 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:54.495562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6b1766e9-9fcf-4535-9f08-0bb8d67ba494 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:54.503227 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6b1766e9-9fcf-4535-9f08-0bb8d67ba494 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.154379 Aug 24 09:05:54.503795 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 584/1135] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:54 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:55.071527 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bd9c87db-13c1-4314-bd6b-f0197a131422 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:55.072186 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bd9c87db-13c1-4314-bd6b-f0197a131422 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:55.078526 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd9c87db-13c1-4314-bd6b-f0197a131422 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:55.079012 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd9c87db-13c1-4314-bd6b-f0197a131422 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:55.079452 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd9c87db-13c1-4314-bd6b-f0197a131422 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:55.080175 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd9c87db-13c1-4314-bd6b-f0197a131422 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:55.080638 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd9c87db-13c1-4314-bd6b-f0197a131422 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:55.081068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bd9c87db-13c1-4314-bd6b-f0197a131422 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:55.213096 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-bd9c87db-13c1-4314-bd6b-f0197a131422 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:55.221238 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-bd9c87db-13c1-4314-bd6b-f0197a131422 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:55.222728 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-bd9c87db-13c1-4314-bd6b-f0197a131422 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:55.223883 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bd9c87db-13c1-4314-bd6b-f0197a131422 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.156461 Aug 24 09:05:55.224584 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 585/1136] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:55 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:55.229749 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c674642b-1c1b-4d4b-813e-bb5edb164fda tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:55.230346 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c674642b-1c1b-4d4b-813e-bb5edb164fda tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:55.232024 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:55.237458 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c674642b-1c1b-4d4b-813e-bb5edb164fda tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:55.237952 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c674642b-1c1b-4d4b-813e-bb5edb164fda tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:55.238391 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c674642b-1c1b-4d4b-813e-bb5edb164fda tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:55.239118 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c674642b-1c1b-4d4b-813e-bb5edb164fda tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:55.239574 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c674642b-1c1b-4d4b-813e-bb5edb164fda tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:55.240001 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c674642b-1c1b-4d4b-813e-bb5edb164fda tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:55.454685 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c674642b-1c1b-4d4b-813e-bb5edb164fda tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:55.463027 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c674642b-1c1b-4d4b-813e-bb5edb164fda tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1145 microversion: 2.1 time: 0.237468 Aug 24 09:05:55.463590 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 586/1137] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:55 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1145 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:55.526226 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-32e1733f-992e-471e-825a-cfe5e1b41e72 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:55.526828 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-32e1733f-992e-471e-825a-cfe5e1b41e72 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:55.532821 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32e1733f-992e-471e-825a-cfe5e1b41e72 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:55.533298 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32e1733f-992e-471e-825a-cfe5e1b41e72 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:55.533729 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32e1733f-992e-471e-825a-cfe5e1b41e72 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:55.534405 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32e1733f-992e-471e-825a-cfe5e1b41e72 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:55.534854 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32e1733f-992e-471e-825a-cfe5e1b41e72 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:55.535273 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-32e1733f-992e-471e-825a-cfe5e1b41e72 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:55.670469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-32e1733f-992e-471e-825a-cfe5e1b41e72 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:55.678229 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-32e1733f-992e-471e-825a-cfe5e1b41e72 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.156740 Aug 24 09:05:55.678803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 587/1138] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:55 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:56.247636 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3973e4b1-36c3-4baa-b5f0-ed5db416868f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:56.248365 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3973e4b1-36c3-4baa-b5f0-ed5db416868f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:56.255213 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3973e4b1-36c3-4baa-b5f0-ed5db416868f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:56.255703 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3973e4b1-36c3-4baa-b5f0-ed5db416868f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:56.256173 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3973e4b1-36c3-4baa-b5f0-ed5db416868f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:56.257600 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3973e4b1-36c3-4baa-b5f0-ed5db416868f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:56.258109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3973e4b1-36c3-4baa-b5f0-ed5db416868f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:56.258486 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3973e4b1-36c3-4baa-b5f0-ed5db416868f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:56.387894 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3973e4b1-36c3-4baa-b5f0-ed5db416868f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:56.396279 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3973e4b1-36c3-4baa-b5f0-ed5db416868f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:56.397782 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3973e4b1-36c3-4baa-b5f0-ed5db416868f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:56.398945 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3973e4b1-36c3-4baa-b5f0-ed5db416868f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.155229 Aug 24 09:05:56.399488 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 588/1139] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:56 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:56.484613 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f2d24ae4-0873-4d39-b5a5-4ae90f9d7f28 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:56.485254 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f2d24ae4-0873-4d39-b5a5-4ae90f9d7f28 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:56.492339 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2d24ae4-0873-4d39-b5a5-4ae90f9d7f28 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:56.492822 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2d24ae4-0873-4d39-b5a5-4ae90f9d7f28 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:56.493256 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2d24ae4-0873-4d39-b5a5-4ae90f9d7f28 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:56.493971 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2d24ae4-0873-4d39-b5a5-4ae90f9d7f28 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:56.494426 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2d24ae4-0873-4d39-b5a5-4ae90f9d7f28 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:56.494850 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f2d24ae4-0873-4d39-b5a5-4ae90f9d7f28 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:56.559425 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f2d24ae4-0873-4d39-b5a5-4ae90f9d7f28 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:56.567552 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f2d24ae4-0873-4d39-b5a5-4ae90f9d7f28 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1137 microversion: 2.1 time: 0.086774 Aug 24 09:05:56.568112 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 589/1140] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:56 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:56.699891 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-524d2012-b491-48d2-b9ce-775d581083ff tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:56.700444 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-524d2012-b491-48d2-b9ce-775d581083ff tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:56.706331 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-524d2012-b491-48d2-b9ce-775d581083ff tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:56.706805 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-524d2012-b491-48d2-b9ce-775d581083ff tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:56.707236 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-524d2012-b491-48d2-b9ce-775d581083ff tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:56.707911 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-524d2012-b491-48d2-b9ce-775d581083ff tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:56.708392 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-524d2012-b491-48d2-b9ce-775d581083ff tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:56.708810 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-524d2012-b491-48d2-b9ce-775d581083ff tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:56.840888 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-524d2012-b491-48d2-b9ce-775d581083ff tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:56.848554 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-524d2012-b491-48d2-b9ce-775d581083ff tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.152594 Aug 24 09:05:56.849113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 590/1141] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:56 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:57.423119 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e39896bf-29b7-4ed6-ad7c-76e4f61a0e40 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:57.423779 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e39896bf-29b7-4ed6-ad7c-76e4f61a0e40 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:57.430785 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e39896bf-29b7-4ed6-ad7c-76e4f61a0e40 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:57.431664 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e39896bf-29b7-4ed6-ad7c-76e4f61a0e40 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:57.432424 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e39896bf-29b7-4ed6-ad7c-76e4f61a0e40 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:57.433512 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e39896bf-29b7-4ed6-ad7c-76e4f61a0e40 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:57.434328 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e39896bf-29b7-4ed6-ad7c-76e4f61a0e40 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:57.434817 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e39896bf-29b7-4ed6-ad7c-76e4f61a0e40 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:57.569229 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e39896bf-29b7-4ed6-ad7c-76e4f61a0e40 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:57.577981 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e39896bf-29b7-4ed6-ad7c-76e4f61a0e40 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:57.579512 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e39896bf-29b7-4ed6-ad7c-76e4f61a0e40 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:57.580714 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e39896bf-29b7-4ed6-ad7c-76e4f61a0e40 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.162256 Aug 24 09:05:57.581278 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 591/1142] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:57 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:05:57.588947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7586a1dd-54f4-4945-95c9-d9a4b33ba44f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:57.589551 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7586a1dd-54f4-4945-95c9-d9a4b33ba44f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:57.595395 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7586a1dd-54f4-4945-95c9-d9a4b33ba44f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:57.595872 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7586a1dd-54f4-4945-95c9-d9a4b33ba44f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:57.596324 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7586a1dd-54f4-4945-95c9-d9a4b33ba44f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:57.597007 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7586a1dd-54f4-4945-95c9-d9a4b33ba44f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:57.597456 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7586a1dd-54f4-4945-95c9-d9a4b33ba44f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:57.597873 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7586a1dd-54f4-4945-95c9-d9a4b33ba44f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:57.663137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-7586a1dd-54f4-4945-95c9-d9a4b33ba44f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:57.670722 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7586a1dd-54f4-4945-95c9-d9a4b33ba44f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1137 microversion: 2.1 time: 0.085393 Aug 24 09:05:57.671290 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 592/1143] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:57 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:57.869147 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d6ffa50a-4bce-4fe3-a628-c6d484f5c06c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:57.869763 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d6ffa50a-4bce-4fe3-a628-c6d484f5c06c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:57.875686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6ffa50a-4bce-4fe3-a628-c6d484f5c06c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:57.876273 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6ffa50a-4bce-4fe3-a628-c6d484f5c06c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:57.876718 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6ffa50a-4bce-4fe3-a628-c6d484f5c06c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:57.877413 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6ffa50a-4bce-4fe3-a628-c6d484f5c06c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:57.877869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6ffa50a-4bce-4fe3-a628-c6d484f5c06c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:57.878299 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d6ffa50a-4bce-4fe3-a628-c6d484f5c06c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:58.008480 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d6ffa50a-4bce-4fe3-a628-c6d484f5c06c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:58.016080 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d6ffa50a-4bce-4fe3-a628-c6d484f5c06c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.150772 Aug 24 09:05:58.016661 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 593/1144] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:57 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:58.604578 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ffdda6d7-af31-4a94-a139-5fc213cbd11f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:58.605264 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ffdda6d7-af31-4a94-a139-5fc213cbd11f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:58.611739 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffdda6d7-af31-4a94-a139-5fc213cbd11f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:58.612261 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffdda6d7-af31-4a94-a139-5fc213cbd11f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:58.612703 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffdda6d7-af31-4a94-a139-5fc213cbd11f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:58.613399 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffdda6d7-af31-4a94-a139-5fc213cbd11f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:58.613859 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffdda6d7-af31-4a94-a139-5fc213cbd11f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:58.614286 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffdda6d7-af31-4a94-a139-5fc213cbd11f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:58.745932 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ffdda6d7-af31-4a94-a139-5fc213cbd11f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:58.754161 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ffdda6d7-af31-4a94-a139-5fc213cbd11f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:58.755784 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ffdda6d7-af31-4a94-a139-5fc213cbd11f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:58.756958 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ffdda6d7-af31-4a94-a139-5fc213cbd11f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.156308 Aug 24 09:05:58.757510 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 594/1145] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:58 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:58.761942 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a8606d12-b0d7-45d6-8c03-9157d5689b75 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:58.762543 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a8606d12-b0d7-45d6-8c03-9157d5689b75 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:58.768189 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8606d12-b0d7-45d6-8c03-9157d5689b75 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:58.768671 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8606d12-b0d7-45d6-8c03-9157d5689b75 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:58.769109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8606d12-b0d7-45d6-8c03-9157d5689b75 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:58.769805 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8606d12-b0d7-45d6-8c03-9157d5689b75 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:58.770518 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8606d12-b0d7-45d6-8c03-9157d5689b75 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:58.770943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a8606d12-b0d7-45d6-8c03-9157d5689b75 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:58.774991 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:58.834312 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a8606d12-b0d7-45d6-8c03-9157d5689b75 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:58.841927 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a8606d12-b0d7-45d6-8c03-9157d5689b75 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1137 microversion: 2.1 time: 0.083467 Aug 24 09:05:58.842494 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 595/1146] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:58 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:05:59.038426 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-95050b3b-8fd4-476f-b9db-e98d8816ed8f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:59.039046 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-95050b3b-8fd4-476f-b9db-e98d8816ed8f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:59.045121 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95050b3b-8fd4-476f-b9db-e98d8816ed8f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:59.045603 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95050b3b-8fd4-476f-b9db-e98d8816ed8f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:59.046036 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95050b3b-8fd4-476f-b9db-e98d8816ed8f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:59.046733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95050b3b-8fd4-476f-b9db-e98d8816ed8f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:59.047204 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95050b3b-8fd4-476f-b9db-e98d8816ed8f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:59.047625 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-95050b3b-8fd4-476f-b9db-e98d8816ed8f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:59.178353 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-95050b3b-8fd4-476f-b9db-e98d8816ed8f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:59.186049 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-95050b3b-8fd4-476f-b9db-e98d8816ed8f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.152056 Aug 24 09:05:59.186710 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 596/1147] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:59 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:05:59.779851 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-245552be-6975-495d-98a8-c48e469a6e2f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:59.780481 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-245552be-6975-495d-98a8-c48e469a6e2f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:59.787544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-245552be-6975-495d-98a8-c48e469a6e2f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:59.788026 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-245552be-6975-495d-98a8-c48e469a6e2f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:59.788482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-245552be-6975-495d-98a8-c48e469a6e2f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:59.789172 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-245552be-6975-495d-98a8-c48e469a6e2f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:59.789622 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-245552be-6975-495d-98a8-c48e469a6e2f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:59.790044 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-245552be-6975-495d-98a8-c48e469a6e2f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:59.918866 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-245552be-6975-495d-98a8-c48e469a6e2f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:59.927105 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-245552be-6975-495d-98a8-c48e469a6e2f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:59.929044 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-245552be-6975-495d-98a8-c48e469a6e2f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:05:59.929949 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-245552be-6975-495d-98a8-c48e469a6e2f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.153932 Aug 24 09:05:59.930493 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 597/1148] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:05:59 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:05:59.934824 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1bf799e7-a024-4616-a071-d1fae14eb9d0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:05:59.935463 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1bf799e7-a024-4616-a071-d1fae14eb9d0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:05:59.941170 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bf799e7-a024-4616-a071-d1fae14eb9d0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:59.941651 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bf799e7-a024-4616-a071-d1fae14eb9d0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:59.942090 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bf799e7-a024-4616-a071-d1fae14eb9d0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:05:59.942823 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bf799e7-a024-4616-a071-d1fae14eb9d0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:05:59.943284 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bf799e7-a024-4616-a071-d1fae14eb9d0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:05:59.943802 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bf799e7-a024-4616-a071-d1fae14eb9d0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:00.007200 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-1bf799e7-a024-4616-a071-d1fae14eb9d0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:00.014878 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1bf799e7-a024-4616-a071-d1fae14eb9d0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1137 microversion: 2.1 time: 0.083435 Aug 24 09:06:00.015437 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 598/1149] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:05:59 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:00.207201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-98f26258-324f-436c-9fa5-9d90b75b2be3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:00.207813 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-98f26258-324f-436c-9fa5-9d90b75b2be3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:00.214399 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98f26258-324f-436c-9fa5-9d90b75b2be3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:00.214888 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98f26258-324f-436c-9fa5-9d90b75b2be3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:00.215330 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98f26258-324f-436c-9fa5-9d90b75b2be3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:00.216027 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98f26258-324f-436c-9fa5-9d90b75b2be3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:00.216690 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98f26258-324f-436c-9fa5-9d90b75b2be3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:00.217288 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-98f26258-324f-436c-9fa5-9d90b75b2be3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:00.382755 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-98f26258-324f-436c-9fa5-9d90b75b2be3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:00.391229 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-98f26258-324f-436c-9fa5-9d90b75b2be3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.187784 Aug 24 09:06:00.396206 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 599/1150] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:00 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:06:00.407684 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4ae788e2-6767-474a-ba1e-1915a9caf234 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "POST /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 17.116748 Aug 24 09:06:00.408338 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 552/1151] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 24 09:05:43 2022] POST /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments => generated 194 bytes in 17118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:00.955203 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c4773853-1a74-4ee2-b37b-6fb3bd92cab9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:00.955818 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c4773853-1a74-4ee2-b37b-6fb3bd92cab9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:00.963310 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4773853-1a74-4ee2-b37b-6fb3bd92cab9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:00.964148 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4773853-1a74-4ee2-b37b-6fb3bd92cab9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:00.964517 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4773853-1a74-4ee2-b37b-6fb3bd92cab9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:00.965339 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4773853-1a74-4ee2-b37b-6fb3bd92cab9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:00.965890 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4773853-1a74-4ee2-b37b-6fb3bd92cab9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:00.966411 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c4773853-1a74-4ee2-b37b-6fb3bd92cab9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:01.038017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6d48beea-45e0-4125-82fb-44ef7e87a5c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:01.038821 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6d48beea-45e0-4125-82fb-44ef7e87a5c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:01.046673 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d48beea-45e0-4125-82fb-44ef7e87a5c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:01.047383 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d48beea-45e0-4125-82fb-44ef7e87a5c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:01.047851 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d48beea-45e0-4125-82fb-44ef7e87a5c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:01.048695 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d48beea-45e0-4125-82fb-44ef7e87a5c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:01.049243 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d48beea-45e0-4125-82fb-44ef7e87a5c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:01.049741 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6d48beea-45e0-4125-82fb-44ef7e87a5c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:01.126231 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-6d48beea-45e0-4125-82fb-44ef7e87a5c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:01.129571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c4773853-1a74-4ee2-b37b-6fb3bd92cab9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:01.134755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6d48beea-45e0-4125-82fb-44ef7e87a5c5 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1193 microversion: 2.1 time: 0.102021 Aug 24 09:06:01.135415 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 553/1152] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:01 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1193 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:06:01.138421 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c4773853-1a74-4ee2-b37b-6fb3bd92cab9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:01.139982 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c4773853-1a74-4ee2-b37b-6fb3bd92cab9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:01.141177 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c4773853-1a74-4ee2-b37b-6fb3bd92cab9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.191880 Aug 24 09:06:01.141734 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 600/1153] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:00 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:06:01.413679 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-4edf141b-20a4-47b7-bd06-688fe2d61e1d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:01.414359 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-4edf141b-20a4-47b7-bd06-688fe2d61e1d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:01.421845 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4edf141b-20a4-47b7-bd06-688fe2d61e1d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:01.422479 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4edf141b-20a4-47b7-bd06-688fe2d61e1d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:01.423154 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4edf141b-20a4-47b7-bd06-688fe2d61e1d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:01.424076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4edf141b-20a4-47b7-bd06-688fe2d61e1d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:01.424791 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4edf141b-20a4-47b7-bd06-688fe2d61e1d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:01.425554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-4edf141b-20a4-47b7-bd06-688fe2d61e1d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:01.606142 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-ed0c33fd-81ac-4a6a-9fe0-ed5cc8399b26 req-ac38996b-cc4c-4781-a84f-a1483dbc9f08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05dfbb2-5e47-4ddf-897d-10e19be499ca", "name": "network-vif-plugged", "status": "completed", "tag": "ca6a6a1a-7c92-4d61-9b26-4ffea23e5485"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:01.627273 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ed0c33fd-81ac-4a6a-9fe0-ed5cc8399b26 req-ac38996b-cc4c-4781-a84f-a1483dbc9f08 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:01.628184 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ed0c33fd-81ac-4a6a-9fe0-ed5cc8399b26 req-ac38996b-cc4c-4781-a84f-a1483dbc9f08 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:01.628865 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-ed0c33fd-81ac-4a6a-9fe0-ed5cc8399b26 req-ac38996b-cc4c-4781-a84f-a1483dbc9f08 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:01.643226 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-ed0c33fd-81ac-4a6a-9fe0-ed5cc8399b26 req-ac38996b-cc4c-4781-a84f-a1483dbc9f08 service nova] Creating event network-vif-plugged:ca6a6a1a-7c92-4d61-9b26-4ffea23e5485 for instance e05dfbb2-5e47-4ddf-897d-10e19be499ca on hv-cinder-83538 Aug 24 09:06:01.650857 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-ed0c33fd-81ac-4a6a-9fe0-ed5cc8399b26 req-ac38996b-cc4c-4781-a84f-a1483dbc9f08 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054376 Aug 24 09:06:01.651579 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 601/1154] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:01.676680 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-4edf141b-20a4-47b7-bd06-688fe2d61e1d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:01.686227 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-4edf141b-20a4-47b7-bd06-688fe2d61e1d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1514 microversion: 2.1 time: 0.277037 Aug 24 09:06:01.686982 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 554/1155] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:01 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1514 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:02.102046 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-4d11cb93-ba97-4132-81bb-2d152a46392e req-aec49c67-38d8-4171-b296-6b94e2c37460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01df6bf-1eb7-43b8-942a-86512183dbdb", "name": "network-vif-deleted", "tag": "bbfd1c5c-8091-4dd7-9a66-f977da83ea6f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:02.122970 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4d11cb93-ba97-4132-81bb-2d152a46392e req-aec49c67-38d8-4171-b296-6b94e2c37460 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:02.123910 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4d11cb93-ba97-4132-81bb-2d152a46392e req-aec49c67-38d8-4171-b296-6b94e2c37460 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:02.124705 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-4d11cb93-ba97-4132-81bb-2d152a46392e req-aec49c67-38d8-4171-b296-6b94e2c37460 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:02.146585 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-4d11cb93-ba97-4132-81bb-2d152a46392e req-aec49c67-38d8-4171-b296-6b94e2c37460 service nova] Creating event network-vif-deleted:bbfd1c5c-8091-4dd7-9a66-f977da83ea6f for instance c01df6bf-1eb7-43b8-942a-86512183dbdb on hv-cinder-83538 Aug 24 09:06:02.155612 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-85e2f3cb-93eb-466c-8e22-ef9624c75450 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:02.156034 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-4d11cb93-ba97-4132-81bb-2d152a46392e req-aec49c67-38d8-4171-b296-6b94e2c37460 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063621 Aug 24 09:06:02.156504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-85e2f3cb-93eb-466c-8e22-ef9624c75450 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:02.157239 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 602/1156] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:02.163855 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85e2f3cb-93eb-466c-8e22-ef9624c75450 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:02.164497 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85e2f3cb-93eb-466c-8e22-ef9624c75450 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:02.165031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85e2f3cb-93eb-466c-8e22-ef9624c75450 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:02.165833 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85e2f3cb-93eb-466c-8e22-ef9624c75450 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:02.166392 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85e2f3cb-93eb-466c-8e22-ef9624c75450 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:02.166908 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-85e2f3cb-93eb-466c-8e22-ef9624c75450 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:02.169310 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-be39f503-f7f3-4745-a058-d9670bc6b525 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:02.170583 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-be39f503-f7f3-4745-a058-d9670bc6b525 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:02.182290 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be39f503-f7f3-4745-a058-d9670bc6b525 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:02.183396 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be39f503-f7f3-4745-a058-d9670bc6b525 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:02.183982 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be39f503-f7f3-4745-a058-d9670bc6b525 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:02.185269 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be39f503-f7f3-4745-a058-d9670bc6b525 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:02.186109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be39f503-f7f3-4745-a058-d9670bc6b525 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:02.186901 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-be39f503-f7f3-4745-a058-d9670bc6b525 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:02.276471 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-85e2f3cb-93eb-466c-8e22-ef9624c75450 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:02.284338 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-85e2f3cb-93eb-466c-8e22-ef9624c75450 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1211 microversion: 2.1 time: 0.133278 Aug 24 09:06:02.284996 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 555/1157] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:02 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1211 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:02.427362 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-be39f503-f7f3-4745-a058-d9670bc6b525 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:02.436077 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-be39f503-f7f3-4745-a058-d9670bc6b525 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:02.437606 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-be39f503-f7f3-4745-a058-d9670bc6b525 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:02.438788 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-be39f503-f7f3-4745-a058-d9670bc6b525 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.277397 Aug 24 09:06:02.439343 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 603/1158] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:02 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:06:02.709913 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-33d58972-a3d8-472c-a9a4-7ae13bfcad09 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:02.711273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-33d58972-a3d8-472c-a9a4-7ae13bfcad09 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:02.717497 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33d58972-a3d8-472c-a9a4-7ae13bfcad09 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:02.718171 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33d58972-a3d8-472c-a9a4-7ae13bfcad09 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:02.718777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33d58972-a3d8-472c-a9a4-7ae13bfcad09 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:02.719878 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33d58972-a3d8-472c-a9a4-7ae13bfcad09 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:02.721306 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33d58972-a3d8-472c-a9a4-7ae13bfcad09 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:02.721908 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33d58972-a3d8-472c-a9a4-7ae13bfcad09 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:02.758556 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33d58972-a3d8-472c-a9a4-7ae13bfcad09 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:02.759045 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33d58972-a3d8-472c-a9a4-7ae13bfcad09 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:02.759478 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-33d58972-a3d8-472c-a9a4-7ae13bfcad09 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:02.759934 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-33d58972-a3d8-472c-a9a4-7ae13bfcad09 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lazy-loading 'fault' on Instance uuid c01df6bf-1eb7-43b8-942a-86512183dbdb {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:06:02.807185 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-33d58972-a3d8-472c-a9a4-7ae13bfcad09 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:02.815223 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-33d58972-a3d8-472c-a9a4-7ae13bfcad09 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 200 len: 1309 microversion: 2.1 time: 0.109889 Aug 24 09:06:02.815792 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 556/1159] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:02 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:03.306487 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9623213f-8349-4a15-a48c-29adf85206a1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:03.307030 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9623213f-8349-4a15-a48c-29adf85206a1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:03.313486 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9623213f-8349-4a15-a48c-29adf85206a1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:03.313966 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9623213f-8349-4a15-a48c-29adf85206a1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:03.314399 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9623213f-8349-4a15-a48c-29adf85206a1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:03.315087 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9623213f-8349-4a15-a48c-29adf85206a1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:03.315537 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9623213f-8349-4a15-a48c-29adf85206a1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:03.315962 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9623213f-8349-4a15-a48c-29adf85206a1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:03.463413 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-119ae344-9ab9-4308-8b05-c93736a8f186 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:03.464280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-119ae344-9ab9-4308-8b05-c93736a8f186 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:03.471495 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-119ae344-9ab9-4308-8b05-c93736a8f186 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:03.471960 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-119ae344-9ab9-4308-8b05-c93736a8f186 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:03.472520 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-119ae344-9ab9-4308-8b05-c93736a8f186 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:03.473354 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-119ae344-9ab9-4308-8b05-c93736a8f186 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:03.474220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-119ae344-9ab9-4308-8b05-c93736a8f186 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:03.474827 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-119ae344-9ab9-4308-8b05-c93736a8f186 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:03.535103 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9623213f-8349-4a15-a48c-29adf85206a1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:03.543649 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9623213f-8349-4a15-a48c-29adf85206a1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1279 microversion: 2.1 time: 0.241095 Aug 24 09:06:03.544339 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 604/1160] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:03 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1279 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:03.735648 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-119ae344-9ab9-4308-8b05-c93736a8f186 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:03.744988 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-119ae344-9ab9-4308-8b05-c93736a8f186 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:03.746590 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-119ae344-9ab9-4308-8b05-c93736a8f186 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:03.747837 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-119ae344-9ab9-4308-8b05-c93736a8f186 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.289188 Aug 24 09:06:03.748483 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 557/1161] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:03 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:06:03.837107 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d495bfb4-2ffe-4522-913d-0ac67423b6c3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:03.837720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d495bfb4-2ffe-4522-913d-0ac67423b6c3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: c01df6bf-1eb7-43b8-942a-86512183dbdb] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:03.844566 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d495bfb4-2ffe-4522-913d-0ac67423b6c3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:03.845058 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d495bfb4-2ffe-4522-913d-0ac67423b6c3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:03.845499 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d495bfb4-2ffe-4522-913d-0ac67423b6c3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:03.846261 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d495bfb4-2ffe-4522-913d-0ac67423b6c3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:03.846776 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d495bfb4-2ffe-4522-913d-0ac67423b6c3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:03.847078 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d495bfb4-2ffe-4522-913d-0ac67423b6c3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:03.861490 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-d495bfb4-2ffe-4522-913d-0ac67423b6c3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] HTTP exception thrown: Instance c01df6bf-1eb7-43b8-942a-86512183dbdb could not be found. Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d495bfb4-2ffe-4522-913d-0ac67423b6c3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Request method failure captured: Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb HTTP/1.1 Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBemQHzOzj4KxBzetQGMfmq7_X6TWVqLDKJXTZetM_TNhPRz3HbIKRNG8nLT_fYLbZ0WunmelvlA8zdVAyDsDUUtaFGpwoArdOwtIvMU0bCcuUSsEX5FvN69pNa7OBf_s7h-Fe2tHGBZ7E8o_uQcThg1xc1qtY67ZTaofeNtLw4ruYfk Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 3e4a52a4c3744faca37f92db4493357a Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2011180662 Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:06:03.863208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:06:03.864907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3e4a52a4c3744faca37f92db4493357a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3e4a52a4c3744faca37f92db4493357a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e4a52a4c3744faca37f92db4493357a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e4a52a4c3744faca37f92db4493357a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:06:03.864907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-VolumesSnapshotTestJSON-2011180662 Aug 24 09:06:03.864907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 3e4a52a4c3744faca37f92db4493357a Aug 24 09:06:03.864907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2011180662 Aug 24 09:06:03.864907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-VolumesSnapshotTestJSON-2011180662-project Aug 24 09:06:03.864907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:06:03.864907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:06:03.864907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: a45d5f4ba3284323bb58bb90625ae94f Aug 24 09:06:03.864907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-VolumesSnapshotTestJSON-2011180662-project Aug 24 09:06:03.864907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:06:03.864907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance c01df6bf-1eb7-43b8-942a-86512183dbdb could not be found. Aug 24 09:06:03.864907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': 'c01df6bf-1eb7-43b8-942a-86512183dbdb'} Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c01df6bf-1eb7-43b8-942a-86512183dbdb could not be found. Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:06:03.865815 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c01df6bf-1eb7-43b8-942a-86512183dbdb could not be found. Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c01df6bf-1eb7-43b8-942a-86512183dbdb could not be found. Aug 24 09:06:03.867400 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:06:03.868631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d495bfb4-2ffe-4522-913d-0ac67423b6c3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Returning 404 to user: Instance c01df6bf-1eb7-43b8-942a-86512183dbdb could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:06:03.868631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d495bfb4-2ffe-4522-913d-0ac67423b6c3 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb" status: 404 len: 111 microversion: 2.1 time: 0.031623 Aug 24 09:06:03.868631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 605/1162] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:03 2022] GET /compute/v2.1/servers/c01df6bf-1eb7-43b8-942a-86512183dbdb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:06:04.217205 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-02f00c7e-be6c-4264-9d3e-7fa5128714dd req-6f6210a4-d0f2-4e13-b8be-57d9d5f9f051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "305f45c9-6610-45f1-ba0b-96088c32bdbd", "tag": "3e1c506d-5244-4f4d-87cb-d02d5c2acbde"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:04.226795 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-02f00c7e-be6c-4264-9d3e-7fa5128714dd req-6f6210a4-d0f2-4e13-b8be-57d9d5f9f051 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:04.227276 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-02f00c7e-be6c-4264-9d3e-7fa5128714dd req-6f6210a4-d0f2-4e13-b8be-57d9d5f9f051 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:04.227712 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-02f00c7e-be6c-4264-9d3e-7fa5128714dd req-6f6210a4-d0f2-4e13-b8be-57d9d5f9f051 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:04.239462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-02f00c7e-be6c-4264-9d3e-7fa5128714dd req-6f6210a4-d0f2-4e13-b8be-57d9d5f9f051 service nova] Creating event network-changed:3e1c506d-5244-4f4d-87cb-d02d5c2acbde for instance 305f45c9-6610-45f1-ba0b-96088c32bdbd on hv-cinder-83538 Aug 24 09:06:04.245594 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-02f00c7e-be6c-4264-9d3e-7fa5128714dd req-6f6210a4-d0f2-4e13-b8be-57d9d5f9f051 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032016 Aug 24 09:06:04.246200 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 558/1163] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:06:04.565687 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9262e8fb-ab2b-40dc-9c18-f76315c3e22b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:04.566973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9262e8fb-ab2b-40dc-9c18-f76315c3e22b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:04.573518 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9262e8fb-ab2b-40dc-9c18-f76315c3e22b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:04.574010 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9262e8fb-ab2b-40dc-9c18-f76315c3e22b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:04.574620 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9262e8fb-ab2b-40dc-9c18-f76315c3e22b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:04.576548 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9262e8fb-ab2b-40dc-9c18-f76315c3e22b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:04.577462 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9262e8fb-ab2b-40dc-9c18-f76315c3e22b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:04.578050 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9262e8fb-ab2b-40dc-9c18-f76315c3e22b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:04.772475 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-da18a547-cc5c-4ea4-8b93-c7157aa6a858 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:04.773233 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-da18a547-cc5c-4ea4-8b93-c7157aa6a858 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:04.779537 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da18a547-cc5c-4ea4-8b93-c7157aa6a858 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:04.780272 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da18a547-cc5c-4ea4-8b93-c7157aa6a858 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:04.780707 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da18a547-cc5c-4ea4-8b93-c7157aa6a858 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:04.781415 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da18a547-cc5c-4ea4-8b93-c7157aa6a858 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:04.781875 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da18a547-cc5c-4ea4-8b93-c7157aa6a858 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:04.782291 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-da18a547-cc5c-4ea4-8b93-c7157aa6a858 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:05.010429 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-da18a547-cc5c-4ea4-8b93-c7157aa6a858 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:05.013777 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9262e8fb-ab2b-40dc-9c18-f76315c3e22b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:05.019755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-da18a547-cc5c-4ea4-8b93-c7157aa6a858 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:05.021307 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-da18a547-cc5c-4ea4-8b93-c7157aa6a858 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:05.022483 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-da18a547-cc5c-4ea4-8b93-c7157aa6a858 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.255408 Aug 24 09:06:05.022733 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9262e8fb-ab2b-40dc-9c18-f76315c3e22b tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1279 microversion: 2.1 time: 0.461139 Aug 24 09:06:05.023033 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 559/1164] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:04 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:06:05.023561 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 606/1165] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:04 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1279 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:06.044870 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7ac4ac7d-c74c-4b9d-b93e-5ec0a4c0c80d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:06.045440 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7ac4ac7d-c74c-4b9d-b93e-5ec0a4c0c80d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:06.046013 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-37d7aebd-34b0-4c87-8639-7bdfa1862153 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:06.046630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-37d7aebd-34b0-4c87-8639-7bdfa1862153 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:06.052487 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ac4ac7d-c74c-4b9d-b93e-5ec0a4c0c80d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:06.052984 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ac4ac7d-c74c-4b9d-b93e-5ec0a4c0c80d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:06.053459 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ac4ac7d-c74c-4b9d-b93e-5ec0a4c0c80d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:06.053895 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37d7aebd-34b0-4c87-8639-7bdfa1862153 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:06.054170 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ac4ac7d-c74c-4b9d-b93e-5ec0a4c0c80d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:06.054489 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37d7aebd-34b0-4c87-8639-7bdfa1862153 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:06.054633 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ac4ac7d-c74c-4b9d-b93e-5ec0a4c0c80d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:06.054861 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37d7aebd-34b0-4c87-8639-7bdfa1862153 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:06.055049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7ac4ac7d-c74c-4b9d-b93e-5ec0a4c0c80d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:06.055571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37d7aebd-34b0-4c87-8639-7bdfa1862153 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:06.056028 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37d7aebd-34b0-4c87-8639-7bdfa1862153 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:06.056502 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-37d7aebd-34b0-4c87-8639-7bdfa1862153 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:06.258730 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-37d7aebd-34b0-4c87-8639-7bdfa1862153 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:06.263397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7ac4ac7d-c74c-4b9d-b93e-5ec0a4c0c80d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:06.268781 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-37d7aebd-34b0-4c87-8639-7bdfa1862153 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:06.270422 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-37d7aebd-34b0-4c87-8639-7bdfa1862153 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:06.271616 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-37d7aebd-34b0-4c87-8639-7bdfa1862153 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.229506 Aug 24 09:06:06.272060 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7ac4ac7d-c74c-4b9d-b93e-5ec0a4c0c80d tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1279 microversion: 2.1 time: 0.231244 Aug 24 09:06:06.272205 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 607/1166] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:06 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:06:06.272747 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 560/1167] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:06 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1279 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:07.293529 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f769a8ca-53eb-472a-948a-265e0766055e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:07.294132 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f769a8ca-53eb-472a-948a-265e0766055e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:07.294722 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1664d0cb-b19a-43df-84a8-b371b8b3398f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:07.295328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1664d0cb-b19a-43df-84a8-b371b8b3398f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:07.301808 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f769a8ca-53eb-472a-948a-265e0766055e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:07.302290 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f769a8ca-53eb-472a-948a-265e0766055e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:07.302657 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1664d0cb-b19a-43df-84a8-b371b8b3398f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:07.302779 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f769a8ca-53eb-472a-948a-265e0766055e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:07.303281 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1664d0cb-b19a-43df-84a8-b371b8b3398f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:07.303439 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f769a8ca-53eb-472a-948a-265e0766055e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:07.303840 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f769a8ca-53eb-472a-948a-265e0766055e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:07.303961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1664d0cb-b19a-43df-84a8-b371b8b3398f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:07.304285 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f769a8ca-53eb-472a-948a-265e0766055e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:07.304788 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1664d0cb-b19a-43df-84a8-b371b8b3398f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:07.305326 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1664d0cb-b19a-43df-84a8-b371b8b3398f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:07.305827 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1664d0cb-b19a-43df-84a8-b371b8b3398f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:07.508221 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1664d0cb-b19a-43df-84a8-b371b8b3398f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:07.512921 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-f769a8ca-53eb-472a-948a-265e0766055e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:07.516588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1664d0cb-b19a-43df-84a8-b371b8b3398f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:07.518922 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1664d0cb-b19a-43df-84a8-b371b8b3398f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:07.520116 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1664d0cb-b19a-43df-84a8-b371b8b3398f tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1729 microversion: 2.20 time: 0.229469 Aug 24 09:06:07.520681 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 561/1168] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:07 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1729 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:06:07.522580 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f769a8ca-53eb-472a-948a-265e0766055e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1279 microversion: 2.1 time: 0.232983 Aug 24 09:06:07.523262 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 608/1169] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:07 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1279 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:08.543603 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d9a6a183-e6c0-4586-8873-190441c7afe0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:08.544370 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d9a6a183-e6c0-4586-8873-190441c7afe0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:08.544773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-594c7e5a-e660-49d8-8135-437b542b0856 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:08.545389 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-594c7e5a-e660-49d8-8135-437b542b0856 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:08.551771 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9a6a183-e6c0-4586-8873-190441c7afe0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:08.552285 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9a6a183-e6c0-4586-8873-190441c7afe0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:08.552711 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-594c7e5a-e660-49d8-8135-437b542b0856 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:08.552820 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9a6a183-e6c0-4586-8873-190441c7afe0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:08.553205 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-594c7e5a-e660-49d8-8135-437b542b0856 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:08.553447 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9a6a183-e6c0-4586-8873-190441c7afe0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:08.553676 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-594c7e5a-e660-49d8-8135-437b542b0856 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:08.553866 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9a6a183-e6c0-4586-8873-190441c7afe0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:08.554292 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9a6a183-e6c0-4586-8873-190441c7afe0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:08.554420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-594c7e5a-e660-49d8-8135-437b542b0856 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:08.554827 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-594c7e5a-e660-49d8-8135-437b542b0856 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:08.555258 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-594c7e5a-e660-49d8-8135-437b542b0856 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:08.760234 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-594c7e5a-e660-49d8-8135-437b542b0856 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:08.764437 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d9a6a183-e6c0-4586-8873-190441c7afe0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:08.768875 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-594c7e5a-e660-49d8-8135-437b542b0856 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1279 microversion: 2.1 time: 0.227709 Aug 24 09:06:08.769463 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 609/1170] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:08 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1279 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:08.773684 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d9a6a183-e6c0-4586-8873-190441c7afe0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:08.775280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d9a6a183-e6c0-4586-8873-190441c7afe0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:08.776482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d9a6a183-e6c0-4586-8873-190441c7afe0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1716 microversion: 2.20 time: 0.236866 Aug 24 09:06:08.777031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 562/1171] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:06:08 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1716 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:06:09.789048 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-ffb970dd-d2e9-453b-92eb-da24b14c766e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:09.789816 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-ffb970dd-d2e9-453b-92eb-da24b14c766e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:09.796502 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffb970dd-d2e9-453b-92eb-da24b14c766e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:09.796999 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffb970dd-d2e9-453b-92eb-da24b14c766e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:09.797441 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffb970dd-d2e9-453b-92eb-da24b14c766e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:09.798647 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffb970dd-d2e9-453b-92eb-da24b14c766e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:09.799111 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffb970dd-d2e9-453b-92eb-da24b14c766e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:09.799542 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-ffb970dd-d2e9-453b-92eb-da24b14c766e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:09.933515 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-ffb970dd-d2e9-453b-92eb-da24b14c766e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:09.941311 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-ffb970dd-d2e9-453b-92eb-da24b14c766e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1279 microversion: 2.1 time: 0.156506 Aug 24 09:06:09.941881 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 610/1172] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:09 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:10.962847 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fceac280-376c-46a8-b1bc-e952aa3efe6c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:10.963683 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fceac280-376c-46a8-b1bc-e952aa3efe6c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:10.972832 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fceac280-376c-46a8-b1bc-e952aa3efe6c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:10.973518 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fceac280-376c-46a8-b1bc-e952aa3efe6c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:10.974146 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fceac280-376c-46a8-b1bc-e952aa3efe6c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:10.974990 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fceac280-376c-46a8-b1bc-e952aa3efe6c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:10.975522 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fceac280-376c-46a8-b1bc-e952aa3efe6c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:10.976046 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fceac280-376c-46a8-b1bc-e952aa3efe6c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:11.127284 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-fceac280-376c-46a8-b1bc-e952aa3efe6c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:11.135119 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fceac280-376c-46a8-b1bc-e952aa3efe6c tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1279 microversion: 2.1 time: 0.177068 Aug 24 09:06:11.135699 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 563/1173] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:10 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:11.177737 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-82ea0533-6464-4b2f-946e-87f40dc88b2a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:11.179889 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-82ea0533-6464-4b2f-946e-87f40dc88b2a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:11.186332 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82ea0533-6464-4b2f-946e-87f40dc88b2a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:11.186820 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82ea0533-6464-4b2f-946e-87f40dc88b2a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:11.187258 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82ea0533-6464-4b2f-946e-87f40dc88b2a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:11.187950 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82ea0533-6464-4b2f-946e-87f40dc88b2a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:11.189456 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82ea0533-6464-4b2f-946e-87f40dc88b2a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:11.189888 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-82ea0533-6464-4b2f-946e-87f40dc88b2a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:11.219363 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-82ea0533-6464-4b2f-946e-87f40dc88b2a tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045531 Aug 24 09:06:11.220317 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 611/1174] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:06:11 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:11.231085 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c210d9f3-a476-47df-b529-31aefd72ec6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:11.231669 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c210d9f3-a476-47df-b529-31aefd72ec6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:11.238751 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c210d9f3-a476-47df-b529-31aefd72ec6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:11.239232 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c210d9f3-a476-47df-b529-31aefd72ec6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:11.239669 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c210d9f3-a476-47df-b529-31aefd72ec6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:11.240379 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c210d9f3-a476-47df-b529-31aefd72ec6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:11.240838 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c210d9f3-a476-47df-b529-31aefd72ec6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:11.241256 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c210d9f3-a476-47df-b529-31aefd72ec6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:11.270332 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c210d9f3-a476-47df-b529-31aefd72ec6e tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments/b608db67-e215-4567-8d0b-dbf95c099028" status: 200 len: 194 microversion: 2.1 time: 0.043137 Aug 24 09:06:11.270908 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 564/1175] 10.222.0.67 () {58 vars in 1413 bytes} [Wed Aug 24 09:06:11 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments/b608db67-e215-4567-8d0b-dbf95c099028 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:12.156502 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e95a8e4e-1f43-4f4a-8e35-c037e0d5187e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:12.157115 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e95a8e4e-1f43-4f4a-8e35-c037e0d5187e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:12.163102 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e95a8e4e-1f43-4f4a-8e35-c037e0d5187e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:12.163586 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e95a8e4e-1f43-4f4a-8e35-c037e0d5187e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:12.164024 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e95a8e4e-1f43-4f4a-8e35-c037e0d5187e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:12.164743 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e95a8e4e-1f43-4f4a-8e35-c037e0d5187e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:12.165200 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e95a8e4e-1f43-4f4a-8e35-c037e0d5187e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:12.165625 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e95a8e4e-1f43-4f4a-8e35-c037e0d5187e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:12.297825 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e95a8e4e-1f43-4f4a-8e35-c037e0d5187e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:12.305588 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e95a8e4e-1f43-4f4a-8e35-c037e0d5187e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1267 microversion: 2.1 time: 0.152966 Aug 24 09:06:12.306164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 612/1176] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:12 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:12.621997 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b471a90f-930a-4fc3-b974-3eece1649250 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4609677-32a3-4faf-8f5b-eeae65aa9342"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:12.624488 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b471a90f-930a-4fc3-b974-3eece1649250 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:12.631767 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b471a90f-930a-4fc3-b974-3eece1649250 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:12.632297 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b471a90f-930a-4fc3-b974-3eece1649250 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:12.632736 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b471a90f-930a-4fc3-b974-3eece1649250 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:12.633428 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b471a90f-930a-4fc3-b974-3eece1649250 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:12.633889 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b471a90f-930a-4fc3-b974-3eece1649250 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:12.634309 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b471a90f-930a-4fc3-b974-3eece1649250 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:13.328831 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3ad8f4df-93ab-4c74-9640-002bafbb27b4 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:13.329580 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3ad8f4df-93ab-4c74-9640-002bafbb27b4 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:13.335839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ad8f4df-93ab-4c74-9640-002bafbb27b4 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:13.336355 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ad8f4df-93ab-4c74-9640-002bafbb27b4 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:13.336795 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ad8f4df-93ab-4c74-9640-002bafbb27b4 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:13.337486 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ad8f4df-93ab-4c74-9640-002bafbb27b4 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:13.337947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ad8f4df-93ab-4c74-9640-002bafbb27b4 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:13.338373 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3ad8f4df-93ab-4c74-9640-002bafbb27b4 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:13.477935 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3ad8f4df-93ab-4c74-9640-002bafbb27b4 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:13.481500 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:13.486782 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3ad8f4df-93ab-4c74-9640-002bafbb27b4 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1267 microversion: 2.1 time: 0.162442 Aug 24 09:06:13.487345 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 613/1177] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:13 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:06:14.507529 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-346a41d5-4a2a-4d7d-a9f0-f0caa2643dc8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:14.508226 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-346a41d5-4a2a-4d7d-a9f0-f0caa2643dc8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:14.514817 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-346a41d5-4a2a-4d7d-a9f0-f0caa2643dc8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:14.515346 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-346a41d5-4a2a-4d7d-a9f0-f0caa2643dc8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:14.515784 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-346a41d5-4a2a-4d7d-a9f0-f0caa2643dc8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:14.516513 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-346a41d5-4a2a-4d7d-a9f0-f0caa2643dc8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:14.516974 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-346a41d5-4a2a-4d7d-a9f0-f0caa2643dc8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:14.517403 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-346a41d5-4a2a-4d7d-a9f0-f0caa2643dc8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:14.647288 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-346a41d5-4a2a-4d7d-a9f0-f0caa2643dc8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:14.657905 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-346a41d5-4a2a-4d7d-a9f0-f0caa2643dc8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1267 microversion: 2.1 time: 0.154418 Aug 24 09:06:14.658620 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 614/1178] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:14 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:06:15.394981 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b471a90f-930a-4fc3-b974-3eece1649250 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "POST /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.776802 Aug 24 09:06:15.395602 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 565/1179] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 24 09:06:12 2022] POST /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments => generated 194 bytes in 2778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:06:15.680112 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bfe75710-f64e-470a-8cf3-761c979aca6f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:15.680773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bfe75710-f64e-470a-8cf3-761c979aca6f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:15.688648 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfe75710-f64e-470a-8cf3-761c979aca6f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:15.689130 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfe75710-f64e-470a-8cf3-761c979aca6f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:15.689562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfe75710-f64e-470a-8cf3-761c979aca6f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:15.690260 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfe75710-f64e-470a-8cf3-761c979aca6f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:15.690709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfe75710-f64e-470a-8cf3-761c979aca6f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:15.691127 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfe75710-f64e-470a-8cf3-761c979aca6f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:15.825339 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-bfe75710-f64e-470a-8cf3-761c979aca6f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:15.833132 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bfe75710-f64e-470a-8cf3-761c979aca6f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1267 microversion: 2.1 time: 0.156915 Aug 24 09:06:15.833693 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 615/1180] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:15 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:16.855280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6a31e8e3-595c-4b16-82fe-519ccece4b66 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:16.856010 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6a31e8e3-595c-4b16-82fe-519ccece4b66 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:16.862420 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a31e8e3-595c-4b16-82fe-519ccece4b66 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:16.862911 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a31e8e3-595c-4b16-82fe-519ccece4b66 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:16.863351 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a31e8e3-595c-4b16-82fe-519ccece4b66 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:16.864046 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a31e8e3-595c-4b16-82fe-519ccece4b66 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:16.864550 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a31e8e3-595c-4b16-82fe-519ccece4b66 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:16.864960 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6a31e8e3-595c-4b16-82fe-519ccece4b66 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:17.001421 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-6a31e8e3-595c-4b16-82fe-519ccece4b66 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:17.009206 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6a31e8e3-595c-4b16-82fe-519ccece4b66 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1267 microversion: 2.1 time: 0.158635 Aug 24 09:06:17.009765 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 566/1181] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:16 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:17.883176 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1259704835", "imageRef": "b3df4874-ed0f-45df-a250-72c886513b9f", "flavorRef": "452", "networks": [{"uuid": "4c7c6569-eafc-438a-bfab-4145fe5a90a5"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:17.939244 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] validate_networks() for [('4c7c6569-eafc-438a-bfab-4145fe5a90a5', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:06:18.031458 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-18e5c41f-bb64-4fd1-bdee-900c810db42e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:18.032130 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-18e5c41f-bb64-4fd1-bdee-900c810db42e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:18.039085 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18e5c41f-bb64-4fd1-bdee-900c810db42e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:18.039625 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18e5c41f-bb64-4fd1-bdee-900c810db42e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:18.040058 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18e5c41f-bb64-4fd1-bdee-900c810db42e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:18.040801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18e5c41f-bb64-4fd1-bdee-900c810db42e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:18.041255 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18e5c41f-bb64-4fd1-bdee-900c810db42e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:18.041673 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-18e5c41f-bb64-4fd1-bdee-900c810db42e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:18.046588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:18.231385 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-18e5c41f-bb64-4fd1-bdee-900c810db42e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:18.239309 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-18e5c41f-bb64-4fd1-bdee-900c810db42e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1267 microversion: 2.1 time: 0.212511 Aug 24 09:06:18.239936 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 567/1182] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:18 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:06:18.394858 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:06:18.395299 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:06:18.395785 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:06:18.396221 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:06:18.396642 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:06:18.405445 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:18.406033 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:18.406373 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:18.407148 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:18.407612 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:18.408039 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:18.429476 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Getting quotas for project 3e4a52a4c3744faca37f92db4493357a. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:06:18.433644 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Getting quotas for user a45d5f4ba3284323bb58bb90625ae94f and project 3e4a52a4c3744faca37f92db4493357a. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:06:18.446935 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:06:18.449357 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3df4874-ed0f-45df-a250-72c886513b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:06:18.497990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e93818b4-3d14-4ba9-a627-e11c7cc22736 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618458 Aug 24 09:06:18.499540 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 616/1183] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 09:06:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:06:18.510284 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-937b53c7-d1e5-4019-8915-e513929e4fe7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:18.510897 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-937b53c7-d1e5-4019-8915-e513929e4fe7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:18.569848 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-937b53c7-d1e5-4019-8915-e513929e4fe7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:18.577392 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-937b53c7-d1e5-4019-8915-e513929e4fe7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 200 len: 1219 microversion: 2.1 time: 0.070893 Aug 24 09:06:18.577966 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 568/1184] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:18 2022] GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:19.260272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cb5cbaff-88e3-4e4d-8c90-47616b8b15f0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:19.260891 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cb5cbaff-88e3-4e4d-8c90-47616b8b15f0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:19.267791 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5cbaff-88e3-4e4d-8c90-47616b8b15f0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:19.268321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5cbaff-88e3-4e4d-8c90-47616b8b15f0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:19.268765 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5cbaff-88e3-4e4d-8c90-47616b8b15f0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:19.269466 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5cbaff-88e3-4e4d-8c90-47616b8b15f0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:19.269926 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5cbaff-88e3-4e4d-8c90-47616b8b15f0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:19.270354 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cb5cbaff-88e3-4e4d-8c90-47616b8b15f0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:19.408623 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cb5cbaff-88e3-4e4d-8c90-47616b8b15f0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:19.416386 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cb5cbaff-88e3-4e4d-8c90-47616b8b15f0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1267 microversion: 2.1 time: 0.159944 Aug 24 09:06:19.416963 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 617/1185] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:19 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:19.598927 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7a0a7aa7-b5f9-460b-a453-f625b9a12c28 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:19.599964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7a0a7aa7-b5f9-460b-a453-f625b9a12c28 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:19.608707 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a0a7aa7-b5f9-460b-a453-f625b9a12c28 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:19.609289 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a0a7aa7-b5f9-460b-a453-f625b9a12c28 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:19.610213 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a0a7aa7-b5f9-460b-a453-f625b9a12c28 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:19.611141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a0a7aa7-b5f9-460b-a453-f625b9a12c28 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:19.611602 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a0a7aa7-b5f9-460b-a453-f625b9a12c28 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:19.612032 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a0a7aa7-b5f9-460b-a453-f625b9a12c28 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:19.699668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7a0a7aa7-b5f9-460b-a453-f625b9a12c28 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:19.712118 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7a0a7aa7-b5f9-460b-a453-f625b9a12c28 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 200 len: 1277 microversion: 2.1 time: 0.117383 Aug 24 09:06:19.713046 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 569/1186] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:19 2022] GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 1277 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:20.438663 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9010fa50-e692-4d1b-8ac2-e2d1a419b541 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:20.439304 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9010fa50-e692-4d1b-8ac2-e2d1a419b541 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:20.445857 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9010fa50-e692-4d1b-8ac2-e2d1a419b541 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:20.446336 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9010fa50-e692-4d1b-8ac2-e2d1a419b541 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:20.446765 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9010fa50-e692-4d1b-8ac2-e2d1a419b541 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:20.447465 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9010fa50-e692-4d1b-8ac2-e2d1a419b541 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:20.447954 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9010fa50-e692-4d1b-8ac2-e2d1a419b541 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:20.448446 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9010fa50-e692-4d1b-8ac2-e2d1a419b541 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:20.690680 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9010fa50-e692-4d1b-8ac2-e2d1a419b541 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:20.698670 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9010fa50-e692-4d1b-8ac2-e2d1a419b541 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1267 microversion: 2.1 time: 0.264778 Aug 24 09:06:20.699248 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 618/1187] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:20 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1267 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:20.733823 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3eb66cc0-d009-44c5-8c7f-e8467d6fed36 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:20.735658 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3eb66cc0-d009-44c5-8c7f-e8467d6fed36 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:20.745837 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3eb66cc0-d009-44c5-8c7f-e8467d6fed36 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:20.746234 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3eb66cc0-d009-44c5-8c7f-e8467d6fed36 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:20.746642 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3eb66cc0-d009-44c5-8c7f-e8467d6fed36 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:20.747958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3eb66cc0-d009-44c5-8c7f-e8467d6fed36 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:20.748452 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3eb66cc0-d009-44c5-8c7f-e8467d6fed36 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:20.748906 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3eb66cc0-d009-44c5-8c7f-e8467d6fed36 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:20.907472 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-a404b64a-ff87-4037-8e32-c5808fe5cf69 req-421eb62c-e507-44ab-ba60-f7f2544f3e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f017099d-af5d-452b-b828-9b231302e0c6", "tag": "e4e1ec9d-eba1-4204-87ef-047a4f022151"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:20.917305 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a404b64a-ff87-4037-8e32-c5808fe5cf69 req-421eb62c-e507-44ab-ba60-f7f2544f3e6c service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:20.917712 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a404b64a-ff87-4037-8e32-c5808fe5cf69 req-421eb62c-e507-44ab-ba60-f7f2544f3e6c service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:20.918153 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-a404b64a-ff87-4037-8e32-c5808fe5cf69 req-421eb62c-e507-44ab-ba60-f7f2544f3e6c service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:20.929918 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-a404b64a-ff87-4037-8e32-c5808fe5cf69 req-421eb62c-e507-44ab-ba60-f7f2544f3e6c service nova] Creating event network-changed:e4e1ec9d-eba1-4204-87ef-047a4f022151 for instance f017099d-af5d-452b-b828-9b231302e0c6 on hv-cinder-83538 Aug 24 09:06:20.935472 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-a404b64a-ff87-4037-8e32-c5808fe5cf69 req-421eb62c-e507-44ab-ba60-f7f2544f3e6c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031038 Aug 24 09:06:20.936441 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 619/1188] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:06:21.014704 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3eb66cc0-d009-44c5-8c7f-e8467d6fed36 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:21.023548 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3eb66cc0-d009-44c5-8c7f-e8467d6fed36 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 200 len: 1319 microversion: 2.1 time: 0.293688 Aug 24 09:06:21.023548 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 570/1189] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:20 2022] GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:21.695556 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-40f8da0c-3e9b-4491-90d1-4d42a42b4168 req-0a577675-3da7-443b-9596-c5560fe7b49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "305f45c9-6610-45f1-ba0b-96088c32bdbd", "name": "network-vif-plugged", "status": "completed", "tag": "3e1c506d-5244-4f4d-87cb-d02d5c2acbde"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:21.706695 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-40f8da0c-3e9b-4491-90d1-4d42a42b4168 req-0a577675-3da7-443b-9596-c5560fe7b49f service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:21.707180 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-40f8da0c-3e9b-4491-90d1-4d42a42b4168 req-0a577675-3da7-443b-9596-c5560fe7b49f service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:21.707608 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-40f8da0c-3e9b-4491-90d1-4d42a42b4168 req-0a577675-3da7-443b-9596-c5560fe7b49f service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:21.719703 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-40f8da0c-3e9b-4491-90d1-4d42a42b4168 req-0a577675-3da7-443b-9596-c5560fe7b49f service nova] Creating event network-vif-plugged:3e1c506d-5244-4f4d-87cb-d02d5c2acbde for instance 305f45c9-6610-45f1-ba0b-96088c32bdbd on hv-cinder-83538 Aug 24 09:06:21.723916 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ae2fa072-bed2-456b-93cd-e7a15ddb5610 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:21.724915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ae2fa072-bed2-456b-93cd-e7a15ddb5610 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:21.725504 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-40f8da0c-3e9b-4491-90d1-4d42a42b4168 req-0a577675-3da7-443b-9596-c5560fe7b49f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033738 Aug 24 09:06:21.726259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 620/1190] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:21.732330 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae2fa072-bed2-456b-93cd-e7a15ddb5610 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:21.733251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae2fa072-bed2-456b-93cd-e7a15ddb5610 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:21.733707 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae2fa072-bed2-456b-93cd-e7a15ddb5610 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:21.734415 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae2fa072-bed2-456b-93cd-e7a15ddb5610 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:21.735513 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae2fa072-bed2-456b-93cd-e7a15ddb5610 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:21.735937 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ae2fa072-bed2-456b-93cd-e7a15ddb5610 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:21.870004 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ae2fa072-bed2-456b-93cd-e7a15ddb5610 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:21.878281 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ae2fa072-bed2-456b-93cd-e7a15ddb5610 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1267 microversion: 2.1 time: 0.160527 Aug 24 09:06:21.878840 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 571/1191] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:21 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:22.044110 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-961d833e-85eb-4fd0-9ca9-e71a5133c0f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:22.044810 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-961d833e-85eb-4fd0-9ca9-e71a5133c0f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:22.050959 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-961d833e-85eb-4fd0-9ca9-e71a5133c0f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:22.051441 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-961d833e-85eb-4fd0-9ca9-e71a5133c0f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:22.051871 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-961d833e-85eb-4fd0-9ca9-e71a5133c0f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:22.052658 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-961d833e-85eb-4fd0-9ca9-e71a5133c0f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:22.053046 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-961d833e-85eb-4fd0-9ca9-e71a5133c0f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:22.053464 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-961d833e-85eb-4fd0-9ca9-e71a5133c0f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:22.186489 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-961d833e-85eb-4fd0-9ca9-e71a5133c0f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:22.194395 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-961d833e-85eb-4fd0-9ca9-e71a5133c0f0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 200 len: 1319 microversion: 2.1 time: 0.154487 Aug 24 09:06:22.194960 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 621/1192] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:22 2022] GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:22.899548 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-515c933b-f32c-4bc2-9bea-5a82166b4051 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:22.900195 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-515c933b-f32c-4bc2-9bea-5a82166b4051 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:22.907738 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-515c933b-f32c-4bc2-9bea-5a82166b4051 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:22.908317 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-515c933b-f32c-4bc2-9bea-5a82166b4051 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:22.908762 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-515c933b-f32c-4bc2-9bea-5a82166b4051 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:22.909464 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-515c933b-f32c-4bc2-9bea-5a82166b4051 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:22.909921 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-515c933b-f32c-4bc2-9bea-5a82166b4051 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:22.910349 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-515c933b-f32c-4bc2-9bea-5a82166b4051 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:23.041575 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-515c933b-f32c-4bc2-9bea-5a82166b4051 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:23.049774 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-515c933b-f32c-4bc2-9bea-5a82166b4051 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1267 microversion: 2.1 time: 0.154083 Aug 24 09:06:23.050335 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 572/1193] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:22 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:23.216050 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-84b6751c-0919-44d6-8f9b-c0faf0bfb5eb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:23.216692 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-84b6751c-0919-44d6-8f9b-c0faf0bfb5eb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:23.223186 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84b6751c-0919-44d6-8f9b-c0faf0bfb5eb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:23.223674 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84b6751c-0919-44d6-8f9b-c0faf0bfb5eb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:23.224138 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84b6751c-0919-44d6-8f9b-c0faf0bfb5eb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:23.224841 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84b6751c-0919-44d6-8f9b-c0faf0bfb5eb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:23.225301 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84b6751c-0919-44d6-8f9b-c0faf0bfb5eb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:23.225728 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84b6751c-0919-44d6-8f9b-c0faf0bfb5eb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:23.358082 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-84b6751c-0919-44d6-8f9b-c0faf0bfb5eb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:23.365691 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-84b6751c-0919-44d6-8f9b-c0faf0bfb5eb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 200 len: 1319 microversion: 2.1 time: 0.153680 Aug 24 09:06:23.366256 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 622/1194] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:23 2022] GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:24.070380 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1012cbe7-d0cd-4071-9af2-6bef2c65061a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:24.070937 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1012cbe7-d0cd-4071-9af2-6bef2c65061a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:24.073234 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=45 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:24.079794 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1012cbe7-d0cd-4071-9af2-6bef2c65061a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:24.080308 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1012cbe7-d0cd-4071-9af2-6bef2c65061a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:24.080751 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1012cbe7-d0cd-4071-9af2-6bef2c65061a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:24.081456 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1012cbe7-d0cd-4071-9af2-6bef2c65061a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:24.081945 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1012cbe7-d0cd-4071-9af2-6bef2c65061a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:24.082368 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1012cbe7-d0cd-4071-9af2-6bef2c65061a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:24.241541 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1012cbe7-d0cd-4071-9af2-6bef2c65061a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:24.249839 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1012cbe7-d0cd-4071-9af2-6bef2c65061a tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1267 microversion: 2.1 time: 0.183402 Aug 24 09:06:24.250392 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 573/1195] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:24 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:24.386065 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dec8a3db-a33d-465f-893a-88222cd6cfc0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:24.386755 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-dec8a3db-a33d-465f-893a-88222cd6cfc0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:24.393417 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dec8a3db-a33d-465f-893a-88222cd6cfc0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:24.393930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dec8a3db-a33d-465f-893a-88222cd6cfc0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:24.394367 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dec8a3db-a33d-465f-893a-88222cd6cfc0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:24.395066 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dec8a3db-a33d-465f-893a-88222cd6cfc0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:24.395526 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dec8a3db-a33d-465f-893a-88222cd6cfc0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:24.395958 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-dec8a3db-a33d-465f-893a-88222cd6cfc0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:24.530942 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-dec8a3db-a33d-465f-893a-88222cd6cfc0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:24.538695 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dec8a3db-a33d-465f-893a-88222cd6cfc0 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 200 len: 1319 microversion: 2.1 time: 0.156935 Aug 24 09:06:24.539264 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 623/1196] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:24 2022] GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:25.271399 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3f37938f-5b93-43c6-836d-7a9736e0b054 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:25.271952 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3f37938f-5b93-43c6-836d-7a9736e0b054 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:25.278425 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f37938f-5b93-43c6-836d-7a9736e0b054 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:25.278903 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f37938f-5b93-43c6-836d-7a9736e0b054 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:25.279336 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f37938f-5b93-43c6-836d-7a9736e0b054 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:25.280022 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f37938f-5b93-43c6-836d-7a9736e0b054 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:25.280504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f37938f-5b93-43c6-836d-7a9736e0b054 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:25.280931 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3f37938f-5b93-43c6-836d-7a9736e0b054 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:25.412758 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3f37938f-5b93-43c6-836d-7a9736e0b054 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:25.421129 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3f37938f-5b93-43c6-836d-7a9736e0b054 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1267 microversion: 2.1 time: 0.153728 Aug 24 09:06:25.421684 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 574/1197] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:25 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:25.560057 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-308254a5-90db-4881-bcbb-0d3f84c7753a tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:25.560708 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-308254a5-90db-4881-bcbb-0d3f84c7753a tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:25.566708 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:25.568780 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-308254a5-90db-4881-bcbb-0d3f84c7753a tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:25.569278 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-308254a5-90db-4881-bcbb-0d3f84c7753a tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:25.569756 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-308254a5-90db-4881-bcbb-0d3f84c7753a tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:25.570667 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-308254a5-90db-4881-bcbb-0d3f84c7753a tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:25.571144 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-308254a5-90db-4881-bcbb-0d3f84c7753a tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:25.571561 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-308254a5-90db-4881-bcbb-0d3f84c7753a tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:25.801844 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-308254a5-90db-4881-bcbb-0d3f84c7753a tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:25.811090 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-308254a5-90db-4881-bcbb-0d3f84c7753a tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 200 len: 1319 microversion: 2.1 time: 0.255589 Aug 24 09:06:25.811677 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 624/1198] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:25 2022] GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:26.141038 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-00f45f5f-2fc5-4751-a309-55042b72c083 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:26.143418 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-00f45f5f-2fc5-4751-a309-55042b72c083 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:26.149721 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00f45f5f-2fc5-4751-a309-55042b72c083 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:26.150206 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00f45f5f-2fc5-4751-a309-55042b72c083 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:26.150634 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00f45f5f-2fc5-4751-a309-55042b72c083 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:26.152302 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00f45f5f-2fc5-4751-a309-55042b72c083 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:26.152800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00f45f5f-2fc5-4751-a309-55042b72c083 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:26.153198 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-00f45f5f-2fc5-4751-a309-55042b72c083 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:26.190826 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-00f45f5f-2fc5-4751-a309-55042b72c083 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053897 Aug 24 09:06:26.191416 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 575/1199] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:06:26 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:06:26.358458 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-0f933491-f5cc-4213-87a5-553ca2031b1d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:26.359139 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-0f933491-f5cc-4213-87a5-553ca2031b1d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:26.365238 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f933491-f5cc-4213-87a5-553ca2031b1d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:26.365720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f933491-f5cc-4213-87a5-553ca2031b1d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:26.366148 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f933491-f5cc-4213-87a5-553ca2031b1d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:26.366839 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f933491-f5cc-4213-87a5-553ca2031b1d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:26.367287 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f933491-f5cc-4213-87a5-553ca2031b1d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:26.367709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-0f933491-f5cc-4213-87a5-553ca2031b1d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:26.399776 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-0f933491-f5cc-4213-87a5-553ca2031b1d tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments/b608db67-e215-4567-8d0b-dbf95c099028" status: 200 len: 194 microversion: 2.1 time: 0.045423 Aug 24 09:06:26.400399 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 625/1200] 10.222.0.67 () {58 vars in 1413 bytes} [Wed Aug 24 09:06:26 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments/b608db67-e215-4567-8d0b-dbf95c099028 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:26.410674 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1dd1370c-aba7-437b-b98c-c2a336b4ed89 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:26.411234 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1dd1370c-aba7-437b-b98c-c2a336b4ed89 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:26.417667 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1dd1370c-aba7-437b-b98c-c2a336b4ed89 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:26.418151 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1dd1370c-aba7-437b-b98c-c2a336b4ed89 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:26.418587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1dd1370c-aba7-437b-b98c-c2a336b4ed89 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:26.419278 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1dd1370c-aba7-437b-b98c-c2a336b4ed89 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:26.419733 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1dd1370c-aba7-437b-b98c-c2a336b4ed89 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:26.420192 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1dd1370c-aba7-437b-b98c-c2a336b4ed89 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:26.442344 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fb25eea0-c42f-4e2b-be8e-8b5050c29258 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:26.442975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fb25eea0-c42f-4e2b-be8e-8b5050c29258 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:26.450436 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb25eea0-c42f-4e2b-be8e-8b5050c29258 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:26.450938 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb25eea0-c42f-4e2b-be8e-8b5050c29258 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:26.451480 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb25eea0-c42f-4e2b-be8e-8b5050c29258 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:26.452230 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb25eea0-c42f-4e2b-be8e-8b5050c29258 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:26.452696 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb25eea0-c42f-4e2b-be8e-8b5050c29258 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:26.453126 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fb25eea0-c42f-4e2b-be8e-8b5050c29258 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:26.512765 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-1dd1370c-aba7-437b-b98c-c2a336b4ed89 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lazy-loading 'services' on Instance uuid ba55dcaa-1454-4bc2-bb93-45abb1e961e2 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:06:26.594912 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1dd1370c-aba7-437b-b98c-c2a336b4ed89 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments/b608db67-e215-4567-8d0b-dbf95c099028" status: 202 len: 0 microversion: 2.1 time: 0.187598 Aug 24 09:06:26.596388 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 576/1201] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 24 09:06:26 2022] DELETE /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments/b608db67-e215-4567-8d0b-dbf95c099028 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:06:26.611147 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-fb25eea0-c42f-4e2b-be8e-8b5050c29258 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:26.618746 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fb25eea0-c42f-4e2b-be8e-8b5050c29258 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1267 microversion: 2.1 time: 0.180191 Aug 24 09:06:26.619276 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 626/1202] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:26 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:06:26.832884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-903b865b-eada-4d85-b02f-dc41b3caf6e6 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:26.833497 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-903b865b-eada-4d85-b02f-dc41b3caf6e6 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:26.839959 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-903b865b-eada-4d85-b02f-dc41b3caf6e6 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:26.840482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-903b865b-eada-4d85-b02f-dc41b3caf6e6 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:26.840929 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-903b865b-eada-4d85-b02f-dc41b3caf6e6 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:26.841633 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-903b865b-eada-4d85-b02f-dc41b3caf6e6 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:26.842088 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-903b865b-eada-4d85-b02f-dc41b3caf6e6 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:26.842514 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-903b865b-eada-4d85-b02f-dc41b3caf6e6 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:26.984273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-903b865b-eada-4d85-b02f-dc41b3caf6e6 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:26.992247 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-903b865b-eada-4d85-b02f-dc41b3caf6e6 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 200 len: 1319 microversion: 2.1 time: 0.163697 Aug 24 09:06:26.992842 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 577/1203] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:26 2022] GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:06:27.641155 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-58ef5df2-a13f-49ae-ba57-7dd539a12448 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:27.641778 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-58ef5df2-a13f-49ae-ba57-7dd539a12448 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:27.647973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58ef5df2-a13f-49ae-ba57-7dd539a12448 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:27.648531 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58ef5df2-a13f-49ae-ba57-7dd539a12448 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:27.648972 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58ef5df2-a13f-49ae-ba57-7dd539a12448 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:27.649672 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58ef5df2-a13f-49ae-ba57-7dd539a12448 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:27.650128 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58ef5df2-a13f-49ae-ba57-7dd539a12448 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:27.650552 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-58ef5df2-a13f-49ae-ba57-7dd539a12448 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:27.776752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-71e151cf-d6fe-4d91-9c49-9dc9d80099c2 req-4a4798e5-3751-4abf-9f38-2478444f4045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f017099d-af5d-452b-b828-9b231302e0c6", "name": "network-vif-plugged", "status": "completed", "tag": "e4e1ec9d-eba1-4204-87ef-047a4f022151"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:27.790041 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-71e151cf-d6fe-4d91-9c49-9dc9d80099c2 req-4a4798e5-3751-4abf-9f38-2478444f4045 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:27.790535 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-71e151cf-d6fe-4d91-9c49-9dc9d80099c2 req-4a4798e5-3751-4abf-9f38-2478444f4045 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:27.790969 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-71e151cf-d6fe-4d91-9c49-9dc9d80099c2 req-4a4798e5-3751-4abf-9f38-2478444f4045 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:27.803631 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-71e151cf-d6fe-4d91-9c49-9dc9d80099c2 req-4a4798e5-3751-4abf-9f38-2478444f4045 service nova] Creating event network-vif-plugged:e4e1ec9d-eba1-4204-87ef-047a4f022151 for instance f017099d-af5d-452b-b828-9b231302e0c6 on hv-cinder-83538 Aug 24 09:06:27.809509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-71e151cf-d6fe-4d91-9c49-9dc9d80099c2 req-4a4798e5-3751-4abf-9f38-2478444f4045 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037979 Aug 24 09:06:27.810504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 578/1204] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:27.842868 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-58ef5df2-a13f-49ae-ba57-7dd539a12448 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:27.851728 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-58ef5df2-a13f-49ae-ba57-7dd539a12448 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1267 microversion: 2.1 time: 0.214563 Aug 24 09:06:27.852450 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 627/1205] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:27 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:28.014151 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1775af62-bc28-49ac-b2ee-d3b1215a542c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:28.014833 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1775af62-bc28-49ac-b2ee-d3b1215a542c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:28.021021 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1775af62-bc28-49ac-b2ee-d3b1215a542c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:28.021500 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1775af62-bc28-49ac-b2ee-d3b1215a542c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:28.021935 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1775af62-bc28-49ac-b2ee-d3b1215a542c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:28.022614 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1775af62-bc28-49ac-b2ee-d3b1215a542c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:28.023160 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1775af62-bc28-49ac-b2ee-d3b1215a542c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:28.023482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1775af62-bc28-49ac-b2ee-d3b1215a542c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:28.156993 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1775af62-bc28-49ac-b2ee-d3b1215a542c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:28.165098 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1775af62-bc28-49ac-b2ee-d3b1215a542c tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 200 len: 1319 microversion: 2.1 time: 0.155564 Aug 24 09:06:28.165664 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 579/1206] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:28 2022] GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:28.873249 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8b7a1d78-ea2f-4fb5-bbda-4201770c7554 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:28.873924 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8b7a1d78-ea2f-4fb5-bbda-4201770c7554 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:28.875883 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:28.876544 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:28.882857 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b7a1d78-ea2f-4fb5-bbda-4201770c7554 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:28.883350 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b7a1d78-ea2f-4fb5-bbda-4201770c7554 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:28.883795 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b7a1d78-ea2f-4fb5-bbda-4201770c7554 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:28.885418 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b7a1d78-ea2f-4fb5-bbda-4201770c7554 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:28.885881 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b7a1d78-ea2f-4fb5-bbda-4201770c7554 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:28.886315 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8b7a1d78-ea2f-4fb5-bbda-4201770c7554 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:29.021552 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8b7a1d78-ea2f-4fb5-bbda-4201770c7554 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:29.029407 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8b7a1d78-ea2f-4fb5-bbda-4201770c7554 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1453 microversion: 2.1 time: 0.160612 Aug 24 09:06:29.029977 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 628/1207] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:28 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:29.047742 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=2 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:29.052799 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ccc8009b-1f41-446d-a067-89cfae1a0025 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:29.053439 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ccc8009b-1f41-446d-a067-89cfae1a0025 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:29.060367 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccc8009b-1f41-446d-a067-89cfae1a0025 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:29.060859 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccc8009b-1f41-446d-a067-89cfae1a0025 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:29.061295 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccc8009b-1f41-446d-a067-89cfae1a0025 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:29.061994 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccc8009b-1f41-446d-a067-89cfae1a0025 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:29.062469 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccc8009b-1f41-446d-a067-89cfae1a0025 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:29.062898 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ccc8009b-1f41-446d-a067-89cfae1a0025 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:29.186932 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c3af8990-d96e-4b67-9099-adf03ceaa25d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:29.188143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c3af8990-d96e-4b67-9099-adf03ceaa25d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:29.194594 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3af8990-d96e-4b67-9099-adf03ceaa25d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:29.195083 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3af8990-d96e-4b67-9099-adf03ceaa25d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:29.195553 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3af8990-d96e-4b67-9099-adf03ceaa25d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:29.196285 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3af8990-d96e-4b67-9099-adf03ceaa25d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:29.196921 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3af8990-d96e-4b67-9099-adf03ceaa25d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:29.197888 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c3af8990-d96e-4b67-9099-adf03ceaa25d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:29.205993 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ccc8009b-1f41-446d-a067-89cfae1a0025 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:29.214941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ccc8009b-1f41-446d-a067-89cfae1a0025 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1453 microversion: 2.1 time: 0.167964 Aug 24 09:06:29.215524 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 580/1208] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:29 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:29.348418 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-c3af8990-d96e-4b67-9099-adf03ceaa25d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:29.356811 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c3af8990-d96e-4b67-9099-adf03ceaa25d tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 200 len: 1319 microversion: 2.1 time: 0.174253 Aug 24 09:06:29.357403 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 629/1209] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:29 2022] GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:06:29.881831 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-39762a23-b961-4dcd-a941-d6cd8f49b243 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:29.882335 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-39762a23-b961-4dcd-a941-d6cd8f49b243 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:29.888951 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39762a23-b961-4dcd-a941-d6cd8f49b243 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:29.889452 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39762a23-b961-4dcd-a941-d6cd8f49b243 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:29.889895 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39762a23-b961-4dcd-a941-d6cd8f49b243 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:29.890601 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39762a23-b961-4dcd-a941-d6cd8f49b243 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:29.891065 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39762a23-b961-4dcd-a941-d6cd8f49b243 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:29.891491 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-39762a23-b961-4dcd-a941-d6cd8f49b243 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:29.923368 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-39762a23-b961-4dcd-a941-d6cd8f49b243 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments/d4609677-32a3-4faf-8f5b-eeae65aa9342" status: 200 len: 194 microversion: 2.1 time: 0.045491 Aug 24 09:06:29.926385 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 581/1210] 10.222.0.67 () {58 vars in 1413 bytes} [Wed Aug 24 09:06:29 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments/d4609677-32a3-4faf-8f5b-eeae65aa9342 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:29.935070 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-11160283-bc68-40f5-b9d3-7d6ae0ec9568 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:29.935649 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-11160283-bc68-40f5-b9d3-7d6ae0ec9568 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:29.941943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11160283-bc68-40f5-b9d3-7d6ae0ec9568 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:29.942425 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11160283-bc68-40f5-b9d3-7d6ae0ec9568 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:29.942855 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11160283-bc68-40f5-b9d3-7d6ae0ec9568 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:29.943549 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11160283-bc68-40f5-b9d3-7d6ae0ec9568 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:29.944009 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11160283-bc68-40f5-b9d3-7d6ae0ec9568 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:29.944459 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11160283-bc68-40f5-b9d3-7d6ae0ec9568 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:30.025845 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-11160283-bc68-40f5-b9d3-7d6ae0ec9568 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lazy-loading 'services' on Instance uuid ba55dcaa-1454-4bc2-bb93-45abb1e961e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:06:30.099276 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-11160283-bc68-40f5-b9d3-7d6ae0ec9568 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments/d4609677-32a3-4faf-8f5b-eeae65aa9342" status: 202 len: 0 microversion: 2.1 time: 0.168556 Aug 24 09:06:30.099979 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 630/1211] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 24 09:06:29 2022] DELETE /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments/d4609677-32a3-4faf-8f5b-eeae65aa9342 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:06:30.378343 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-83751217-4199-47b7-ab28-6ecbdc36d5ea tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:30.378955 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-83751217-4199-47b7-ab28-6ecbdc36d5ea tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:30.385999 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83751217-4199-47b7-ab28-6ecbdc36d5ea tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:30.386485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83751217-4199-47b7-ab28-6ecbdc36d5ea tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:30.387102 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83751217-4199-47b7-ab28-6ecbdc36d5ea tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:30.387800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83751217-4199-47b7-ab28-6ecbdc36d5ea tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:30.388509 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83751217-4199-47b7-ab28-6ecbdc36d5ea tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:30.389098 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-83751217-4199-47b7-ab28-6ecbdc36d5ea tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:30.554476 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-83751217-4199-47b7-ab28-6ecbdc36d5ea tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:30.562768 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-83751217-4199-47b7-ab28-6ecbdc36d5ea tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 200 len: 1319 microversion: 2.1 time: 0.188893 Aug 24 09:06:30.563338 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 582/1212] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:30 2022] GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:31.221989 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-8bf53789-8e6a-4f69-8037-eb3d7589c950 req-a74b9f3b-3984-4345-a87a-2ce78f9c94f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "305f45c9-6610-45f1-ba0b-96088c32bdbd", "tag": "3e1c506d-5244-4f4d-87cb-d02d5c2acbde"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:31.236417 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8bf53789-8e6a-4f69-8037-eb3d7589c950 req-a74b9f3b-3984-4345-a87a-2ce78f9c94f7 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:31.237329 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8bf53789-8e6a-4f69-8037-eb3d7589c950 req-a74b9f3b-3984-4345-a87a-2ce78f9c94f7 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:31.237954 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-8bf53789-8e6a-4f69-8037-eb3d7589c950 req-a74b9f3b-3984-4345-a87a-2ce78f9c94f7 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:31.263497 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-8bf53789-8e6a-4f69-8037-eb3d7589c950 req-a74b9f3b-3984-4345-a87a-2ce78f9c94f7 service nova] Creating event network-changed:3e1c506d-5244-4f4d-87cb-d02d5c2acbde for instance 305f45c9-6610-45f1-ba0b-96088c32bdbd on hv-cinder-83538 Aug 24 09:06:31.269222 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-8bf53789-8e6a-4f69-8037-eb3d7589c950 req-a74b9f3b-3984-4345-a87a-2ce78f9c94f7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051318 Aug 24 09:06:31.270053 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 631/1213] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:31.583911 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7f44ce76-07bc-4500-82b4-9a5563016c02 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:31.584570 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7f44ce76-07bc-4500-82b4-9a5563016c02 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:31.591764 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f44ce76-07bc-4500-82b4-9a5563016c02 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:31.592289 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f44ce76-07bc-4500-82b4-9a5563016c02 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:31.592779 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f44ce76-07bc-4500-82b4-9a5563016c02 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:31.593480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f44ce76-07bc-4500-82b4-9a5563016c02 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:31.594118 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f44ce76-07bc-4500-82b4-9a5563016c02 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:31.594736 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7f44ce76-07bc-4500-82b4-9a5563016c02 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:31.843620 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-7f44ce76-07bc-4500-82b4-9a5563016c02 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:31.853156 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7f44ce76-07bc-4500-82b4-9a5563016c02 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 200 len: 1507 microversion: 2.1 time: 0.272465 Aug 24 09:06:31.854469 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 583/1214] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:31 2022] GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:31.878153 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-7d862dce-cc8d-4ee1-a213-f4d77b425324 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35c9a59f-9c09-4455-82db-f54bd34b526a", "device": "/dev/sdb"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:31.881212 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-7d862dce-cc8d-4ee1-a213-f4d77b425324 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:31.888710 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d862dce-cc8d-4ee1-a213-f4d77b425324 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:31.889513 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d862dce-cc8d-4ee1-a213-f4d77b425324 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:31.890108 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d862dce-cc8d-4ee1-a213-f4d77b425324 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:31.890998 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d862dce-cc8d-4ee1-a213-f4d77b425324 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:31.891621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d862dce-cc8d-4ee1-a213-f4d77b425324 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:31.892233 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-7d862dce-cc8d-4ee1-a213-f4d77b425324 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:31.912898 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:32.230738 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-7d862dce-cc8d-4ee1-a213-f4d77b425324 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "POST /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358349 Aug 24 09:06:32.232183 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 632/1215] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 24 09:06:31 2022] POST /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:32.397839 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9640ea82-eb84-4e46-b34d-df1108f8901f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:32.400178 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9640ea82-eb84-4e46-b34d-df1108f8901f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:32.406468 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9640ea82-eb84-4e46-b34d-df1108f8901f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:32.406974 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9640ea82-eb84-4e46-b34d-df1108f8901f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:32.407415 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9640ea82-eb84-4e46-b34d-df1108f8901f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:32.408473 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9640ea82-eb84-4e46-b34d-df1108f8901f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:32.408933 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9640ea82-eb84-4e46-b34d-df1108f8901f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:32.409395 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9640ea82-eb84-4e46-b34d-df1108f8901f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:32.438713 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:32.444021 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9640ea82-eb84-4e46-b34d-df1108f8901f tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050920 Aug 24 09:06:32.444639 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 584/1216] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:06:32 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 09:06:32.564268 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-99732956-ce89-4384-b81b-0cfc3dd0e101 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:32.566496 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-99732956-ce89-4384-b81b-0cfc3dd0e101 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:32.573529 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99732956-ce89-4384-b81b-0cfc3dd0e101 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:32.574017 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99732956-ce89-4384-b81b-0cfc3dd0e101 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:32.574455 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99732956-ce89-4384-b81b-0cfc3dd0e101 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:32.575153 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99732956-ce89-4384-b81b-0cfc3dd0e101 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:32.575610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99732956-ce89-4384-b81b-0cfc3dd0e101 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:32.576036 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-99732956-ce89-4384-b81b-0cfc3dd0e101 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:32.605392 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-99732956-ce89-4384-b81b-0cfc3dd0e101 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045894 Aug 24 09:06:32.605949 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 633/1217] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:06:32 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:06:32.668673 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-fe0f8260-a3fb-4f16-af8b-f6df0e493a01 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:32.669218 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fe0f8260-a3fb-4f16-af8b-f6df0e493a01 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:32.676869 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe0f8260-a3fb-4f16-af8b-f6df0e493a01 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:32.677360 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe0f8260-a3fb-4f16-af8b-f6df0e493a01 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:32.677801 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe0f8260-a3fb-4f16-af8b-f6df0e493a01 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:32.678541 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe0f8260-a3fb-4f16-af8b-f6df0e493a01 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:32.679001 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe0f8260-a3fb-4f16-af8b-f6df0e493a01 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:32.679424 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-fe0f8260-a3fb-4f16-af8b-f6df0e493a01 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:32.707274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-fe0f8260-a3fb-4f16-af8b-f6df0e493a01 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:06:32.794696 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-fe0f8260-a3fb-4f16-af8b-f6df0e493a01 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 204 len: 0 microversion: 2.1 time: 0.129639 Aug 24 09:06:32.795562 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 585/1218] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:06:32 2022] DELETE /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:06:32.804077 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bccfd740-6ae5-4df5-ac68-c089cafa0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:32.804911 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bccfd740-6ae5-4df5-ac68-c089cafa0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:32.811764 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bccfd740-6ae5-4df5-ac68-c089cafa0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:32.812287 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bccfd740-6ae5-4df5-ac68-c089cafa0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:32.812719 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bccfd740-6ae5-4df5-ac68-c089cafa0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:32.813416 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bccfd740-6ae5-4df5-ac68-c089cafa0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:32.813868 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bccfd740-6ae5-4df5-ac68-c089cafa0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:32.814288 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bccfd740-6ae5-4df5-ac68-c089cafa0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:32.944447 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-bccfd740-6ae5-4df5-ac68-c089cafa0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:32.952448 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bccfd740-6ae5-4df5-ac68-c089cafa0ec3 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1673 microversion: 2.1 time: 0.152463 Aug 24 09:06:32.953029 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 634/1219] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:32 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:33.974948 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6512a2f6-3091-489b-8e0f-f3a7f4983aaa tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:33.975649 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6512a2f6-3091-489b-8e0f-f3a7f4983aaa tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:33.982895 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6512a2f6-3091-489b-8e0f-f3a7f4983aaa tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:33.983382 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6512a2f6-3091-489b-8e0f-f3a7f4983aaa tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:33.983820 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6512a2f6-3091-489b-8e0f-f3a7f4983aaa tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:33.984792 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6512a2f6-3091-489b-8e0f-f3a7f4983aaa tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:33.985380 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6512a2f6-3091-489b-8e0f-f3a7f4983aaa tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:33.985813 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6512a2f6-3091-489b-8e0f-f3a7f4983aaa tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:34.120710 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-6512a2f6-3091-489b-8e0f-f3a7f4983aaa tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:34.129286 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6512a2f6-3091-489b-8e0f-f3a7f4983aaa tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1673 microversion: 2.1 time: 0.158043 Aug 24 09:06:34.129799 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 586/1220] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:33 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:35.151240 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bfeab7c7-5c14-4f9a-abb4-3dcce240ce71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:35.151899 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bfeab7c7-5c14-4f9a-abb4-3dcce240ce71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:35.158610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfeab7c7-5c14-4f9a-abb4-3dcce240ce71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:35.159106 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfeab7c7-5c14-4f9a-abb4-3dcce240ce71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:35.159550 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfeab7c7-5c14-4f9a-abb4-3dcce240ce71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:35.160311 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfeab7c7-5c14-4f9a-abb4-3dcce240ce71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:35.160776 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfeab7c7-5c14-4f9a-abb4-3dcce240ce71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:35.161199 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bfeab7c7-5c14-4f9a-abb4-3dcce240ce71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:35.375842 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-bfeab7c7-5c14-4f9a-abb4-3dcce240ce71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:35.384216 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bfeab7c7-5c14-4f9a-abb4-3dcce240ce71 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1673 microversion: 2.1 time: 0.237437 Aug 24 09:06:35.384800 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 635/1221] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:35 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1673 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:36.136008 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-c1b29e6d-06a1-4869-9dee-82e6357ee462 req-6e886f20-17f7-4b64-b7a9-f80b88ba8c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba55dcaa-1454-4bc2-bb93-45abb1e961e2", "name": "network-vif-deleted", "tag": "18799bbd-7263-47b4-81aa-45798f3eea8b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:06:36.150323 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c1b29e6d-06a1-4869-9dee-82e6357ee462 req-6e886f20-17f7-4b64-b7a9-f80b88ba8c4e service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:36.151057 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c1b29e6d-06a1-4869-9dee-82e6357ee462 req-6e886f20-17f7-4b64-b7a9-f80b88ba8c4e service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:36.151726 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-c1b29e6d-06a1-4869-9dee-82e6357ee462 req-6e886f20-17f7-4b64-b7a9-f80b88ba8c4e service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:36.167555 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-c1b29e6d-06a1-4869-9dee-82e6357ee462 req-6e886f20-17f7-4b64-b7a9-f80b88ba8c4e service nova] Creating event network-vif-deleted:18799bbd-7263-47b4-81aa-45798f3eea8b for instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 on hv-cinder-83538 Aug 24 09:06:36.173813 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-c1b29e6d-06a1-4869-9dee-82e6357ee462 req-6e886f20-17f7-4b64-b7a9-f80b88ba8c4e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110011 Aug 24 09:06:36.180886 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 587/1222] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:06:36.581100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a3ec6cc7-972d-410c-85ab-3d48c4104efe tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:36.581872 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a3ec6cc7-972d-410c-85ab-3d48c4104efe tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:36.589374 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3ec6cc7-972d-410c-85ab-3d48c4104efe tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:36.590093 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3ec6cc7-972d-410c-85ab-3d48c4104efe tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:36.590741 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3ec6cc7-972d-410c-85ab-3d48c4104efe tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:36.591660 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3ec6cc7-972d-410c-85ab-3d48c4104efe tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:36.592186 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3ec6cc7-972d-410c-85ab-3d48c4104efe tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:36.592645 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3ec6cc7-972d-410c-85ab-3d48c4104efe tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:36.625874 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3ec6cc7-972d-410c-85ab-3d48c4104efe tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:36.626366 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3ec6cc7-972d-410c-85ab-3d48c4104efe tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:36.626829 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a3ec6cc7-972d-410c-85ab-3d48c4104efe tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:36.627251 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-a3ec6cc7-972d-410c-85ab-3d48c4104efe tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lazy-loading 'fault' on Instance uuid ba55dcaa-1454-4bc2-bb93-45abb1e961e2 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:06:36.676612 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-a3ec6cc7-972d-410c-85ab-3d48c4104efe tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0dc2dcc5327489c9ecc28a43ab7c0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6e1733fd9d4f5096c35e99dd56945b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:06:36.684467 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a3ec6cc7-972d-410c-85ab-3d48c4104efe tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 200 len: 1327 microversion: 2.1 time: 0.283380 Aug 24 09:06:36.685036 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 636/1223] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:36 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 1327 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:06:37.706595 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6b764db5-19e3-4743-a072-59c0e04a6fb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:37.707527 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6b764db5-19e3-4743-a072-59c0e04a6fb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:37.715450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b764db5-19e3-4743-a072-59c0e04a6fb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:37.715952 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b764db5-19e3-4743-a072-59c0e04a6fb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:37.716462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b764db5-19e3-4743-a072-59c0e04a6fb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:37.717180 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b764db5-19e3-4743-a072-59c0e04a6fb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:37.717641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b764db5-19e3-4743-a072-59c0e04a6fb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:37.718101 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6b764db5-19e3-4743-a072-59c0e04a6fb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:37.734451 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-6b764db5-19e3-4743-a072-59c0e04a6fb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] HTTP exception thrown: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6b764db5-19e3-4743-a072-59c0e04a6fb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Request method failure captured: Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 HTTP/1.1 Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeLb9AVLkFNdXtxTkq6l9eqZkrRWwz_AmC6cxAgei9IOBobTIVhN8gWeBLXOd_GqP9sgsTvEXru3c2GlG1bT4gPmGAa7yuDn9mUTomBxK4jh5RYpuKPxzUKsGuXdSj_tD6wDWW7BNZ01ilKkuTTNBzdxrbIj2uxb3ckDE1URCyiZig Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: bd6e1733fd9d4f5096c35e99dd56945b Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:06:37.736141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:06:37.737645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:06:37.737645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:06:37.737645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: bd6e1733fd9d4f5096c35e99dd56945b Aug 24 09:06:37.737645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:06:37.737645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-AttachVolumeTestJSON-591255449-project Aug 24 09:06:37.737645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:06:37.737645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:06:37.737645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: f0dc2dcc5327489c9ecc28a43ab7c0e2 Aug 24 09:06:37.737645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeTestJSON-591255449-project Aug 24 09:06:37.737645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:06:37.737645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. Aug 24 09:06:37.737645 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': 'ba55dcaa-1454-4bc2-bb93-45abb1e961e2'} Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:06:37.738508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. Aug 24 09:06:37.739858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:06:37.743347 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6b764db5-19e3-4743-a072-59c0e04a6fb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Returning 404 to user: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:06:37.743347 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6b764db5-19e3-4743-a072-59c0e04a6fb6 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 404 len: 111 microversion: 2.1 time: 0.035540 Aug 24 09:06:37.743347 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 588/1224] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:37 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:06:37.748366 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f5b9d25d-b0f2-4bd7-bdd9-53673b5f7df8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '.version_select at 0x7fb140cf6af0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:37.768529 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f5b9d25d-b0f2-4bd7-bdd9-53673b5f7df8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-953611460" status: 202 len: 0 microversion: 2.1 time: 0.024998 Aug 24 09:06:37.769109 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 637/1225] 10.222.0.67 () {58 vars in 1218 bytes} [Wed Aug 24 09:06:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-953611460 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:06:40.686238 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7a38bda2-6865-44f2-8055-8d294cf1a183 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:40.686807 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-7a38bda2-6865-44f2-8055-8d294cf1a183 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:40.693473 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a38bda2-6865-44f2-8055-8d294cf1a183 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:40.693964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a38bda2-6865-44f2-8055-8d294cf1a183 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:40.694401 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a38bda2-6865-44f2-8055-8d294cf1a183 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:40.695215 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a38bda2-6865-44f2-8055-8d294cf1a183 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:40.695679 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a38bda2-6865-44f2-8055-8d294cf1a183 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:40.696128 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-7a38bda2-6865-44f2-8055-8d294cf1a183 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:40.709865 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-7a38bda2-6865-44f2-8055-8d294cf1a183 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] HTTP exception thrown: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7a38bda2-6865-44f2-8055-8d294cf1a183 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Request method failure captured: Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 HTTP/1.1 Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeLb9AVLkFNdXtxTkq6l9eqZkrRWwz_AmC6cxAgei9IOBobTIVhN8gWeBLXOd_GqP9sgsTvEXru3c2GlG1bT4gPmGAa7yuDn9mUTomBxK4jh5RYpuKPxzUKsGuXdSj_tD6wDWW7BNZ01ilKkuTTNBzdxrbIj2uxb3ckDE1URCyiZig Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: bd6e1733fd9d4f5096c35e99dd56945b Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:06:40.711958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:06:40.713597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:06:40.713597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:06:40.713597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: bd6e1733fd9d4f5096c35e99dd56945b Aug 24 09:06:40.713597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:06:40.713597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-AttachVolumeTestJSON-591255449-project Aug 24 09:06:40.713597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:06:40.713597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:06:40.713597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: f0dc2dcc5327489c9ecc28a43ab7c0e2 Aug 24 09:06:40.713597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeTestJSON-591255449-project Aug 24 09:06:40.713597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:06:40.713597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. Aug 24 09:06:40.713597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': 'ba55dcaa-1454-4bc2-bb93-45abb1e961e2'} Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:06:40.715275 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. Aug 24 09:06:40.716588 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:06:40.717912 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-7a38bda2-6865-44f2-8055-8d294cf1a183 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Returning 404 to user: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:06:40.717912 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-7a38bda2-6865-44f2-8055-8d294cf1a183 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 404 len: 111 microversion: 2.1 time: 0.031122 Aug 24 09:06:40.717912 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 589/1226] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:06:40 2022] DELETE /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:06:40.722757 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-985c0b78-3251-4469-9177-e287cc72b1e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:40.723387 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-985c0b78-3251-4469-9177-e287cc72b1e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: ba55dcaa-1454-4bc2-bb93-45abb1e961e2] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:40.730127 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-985c0b78-3251-4469-9177-e287cc72b1e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:40.730612 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-985c0b78-3251-4469-9177-e287cc72b1e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:40.731050 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-985c0b78-3251-4469-9177-e287cc72b1e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:40.731742 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-985c0b78-3251-4469-9177-e287cc72b1e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:40.732231 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-985c0b78-3251-4469-9177-e287cc72b1e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:40.732662 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-985c0b78-3251-4469-9177-e287cc72b1e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:40.746869 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-985c0b78-3251-4469-9177-e287cc72b1e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] HTTP exception thrown: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-985c0b78-3251-4469-9177-e287cc72b1e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Request method failure captured: Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 HTTP/1.1 Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeeLb9AVLkFNdXtxTkq6l9eqZkrRWwz_AmC6cxAgei9IOBobTIVhN8gWeBLXOd_GqP9sgsTvEXru3c2GlG1bT4gPmGAa7yuDn9mUTomBxK4jh5RYpuKPxzUKsGuXdSj_tD6wDWW7BNZ01ilKkuTTNBzdxrbIj2uxb3ckDE1URCyiZig Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: bd6e1733fd9d4f5096c35e99dd56945b Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:06:40.748577 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:06:40.749930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:06:40.749930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:06:40.749930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: bd6e1733fd9d4f5096c35e99dd56945b Aug 24 09:06:40.749930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:06:40.749930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-AttachVolumeTestJSON-591255449-project Aug 24 09:06:40.749930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:06:40.749930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:06:40.749930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: f0dc2dcc5327489c9ecc28a43ab7c0e2 Aug 24 09:06:40.749930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeTestJSON-591255449-project Aug 24 09:06:40.749930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:06:40.749930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. Aug 24 09:06:40.749930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': 'ba55dcaa-1454-4bc2-bb93-45abb1e961e2'} Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:06:40.750686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. Aug 24 09:06:40.752113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:06:40.753502 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-985c0b78-3251-4469-9177-e287cc72b1e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Returning 404 to user: Instance ba55dcaa-1454-4bc2-bb93-45abb1e961e2 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:06:40.753502 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-985c0b78-3251-4469-9177-e287cc72b1e8 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2" status: 404 len: 111 microversion: 2.1 time: 0.031865 Aug 24 09:06:40.753502 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 638/1227] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:40 2022] GET /compute/v2.1/servers/ba55dcaa-1454-4bc2-bb93-45abb1e961e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:06:41.908371 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b480c65c-0e04-4f9e-96ac-9718c1a22c35 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:41.908896 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b480c65c-0e04-4f9e-96ac-9718c1a22c35 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:41.920163 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b480c65c-0e04-4f9e-96ac-9718c1a22c35 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:41.920668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b480c65c-0e04-4f9e-96ac-9718c1a22c35 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:41.921119 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b480c65c-0e04-4f9e-96ac-9718c1a22c35 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:41.921843 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b480c65c-0e04-4f9e-96ac-9718c1a22c35 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:41.922309 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b480c65c-0e04-4f9e-96ac-9718c1a22c35 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:41.922743 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b480c65c-0e04-4f9e-96ac-9718c1a22c35 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:41.939141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-b480c65c-0e04-4f9e-96ac-9718c1a22c35 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] HTTP exception thrown: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b480c65c-0e04-4f9e-96ac-9718c1a22c35 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Request method failure captured: Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 HTTP/1.1 Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeLb9AVLkFNdXtxTkq6l9eqZkrRWwz_AmC6cxAgei9IOBobTIVhN8gWeBLXOd_GqP9sgsTvEXru3c2GlG1bT4gPmGAa7yuDn9mUTomBxK4jh5RYpuKPxzUKsGuXdSj_tD6wDWW7BNZ01ilKkuTTNBzdxrbIj2uxb3ckDE1URCyiZig Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: bd6e1733fd9d4f5096c35e99dd56945b Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:06:41.940755 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:06:41.942334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:06:41.942334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:06:41.942334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: bd6e1733fd9d4f5096c35e99dd56945b Aug 24 09:06:41.942334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:06:41.942334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-AttachVolumeTestJSON-591255449-project Aug 24 09:06:41.942334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:06:41.942334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:06:41.942334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: f0dc2dcc5327489c9ecc28a43ab7c0e2 Aug 24 09:06:41.942334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeTestJSON-591255449-project Aug 24 09:06:41.942334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:06:41.942334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. Aug 24 09:06:41.942334 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': '2489f27e-e91b-4e45-8072-7b4226f576f8'} Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:06:41.943173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. Aug 24 09:06:41.944962 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:06:41.946327 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b480c65c-0e04-4f9e-96ac-9718c1a22c35 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Returning 404 to user: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:06:41.946327 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b480c65c-0e04-4f9e-96ac-9718c1a22c35 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 404 len: 111 microversion: 2.1 time: 0.037727 Aug 24 09:06:41.946327 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 590/1228] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:06:41 2022] DELETE /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:06:41.951603 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-01176c74-4f5b-4d9f-97ee-ef1fd77f1438 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:41.952276 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-01176c74-4f5b-4d9f-97ee-ef1fd77f1438 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] [instance: 2489f27e-e91b-4e45-8072-7b4226f576f8] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:41.958782 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01176c74-4f5b-4d9f-97ee-ef1fd77f1438 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:41.959263 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01176c74-4f5b-4d9f-97ee-ef1fd77f1438 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:41.960546 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01176c74-4f5b-4d9f-97ee-ef1fd77f1438 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:41.961105 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01176c74-4f5b-4d9f-97ee-ef1fd77f1438 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:06:41.961506 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01176c74-4f5b-4d9f-97ee-ef1fd77f1438 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:06:41.961934 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-01176c74-4f5b-4d9f-97ee-ef1fd77f1438 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:06:41.977957 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-01176c74-4f5b-4d9f-97ee-ef1fd77f1438 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] HTTP exception thrown: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-01176c74-4f5b-4d9f-97ee-ef1fd77f1438 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Request method failure captured: Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 HTTP/1.1 Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeeLb9AVLkFNdXtxTkq6l9eqZkrRWwz_AmC6cxAgei9IOBobTIVhN8gWeBLXOd_GqP9sgsTvEXru3c2GlG1bT4gPmGAa7yuDn9mUTomBxK4jh5RYpuKPxzUKsGuXdSj_tD6wDWW7BNZ01ilKkuTTNBzdxrbIj2uxb3ckDE1URCyiZig Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: bd6e1733fd9d4f5096c35e99dd56945b Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:06:41.979498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:06:41.981137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/bd6e1733fd9d4f5096c35e99dd56945b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:06:41.981137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:06:41.981137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: bd6e1733fd9d4f5096c35e99dd56945b Aug 24 09:06:41.981137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeTestJSON-591255449 Aug 24 09:06:41.981137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-AttachVolumeTestJSON-591255449-project Aug 24 09:06:41.981137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:06:41.981137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:06:41.981137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: f0dc2dcc5327489c9ecc28a43ab7c0e2 Aug 24 09:06:41.981137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeTestJSON-591255449-project Aug 24 09:06:41.981137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:06:41.981137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. Aug 24 09:06:41.981137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '2489f27e-e91b-4e45-8072-7b4226f576f8'} Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:06:41.982792 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. Aug 24 09:06:41.984280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:06:41.985583 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-01176c74-4f5b-4d9f-97ee-ef1fd77f1438 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] Returning 404 to user: Instance 2489f27e-e91b-4e45-8072-7b4226f576f8 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:06:41.985583 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-01176c74-4f5b-4d9f-97ee-ef1fd77f1438 tempest-AttachVolumeTestJSON-591255449 tempest-AttachVolumeTestJSON-591255449-project] 10.222.0.67 "GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8" status: 404 len: 111 microversion: 2.1 time: 0.033184 Aug 24 09:06:41.985583 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 639/1229] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:06:41 2022] GET /compute/v2.1/servers/2489f27e-e91b-4e45-8072-7b4226f576f8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:06:59.991076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8144b497-fe85-4fb9-b6b4-22ac9b4904e7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:06:59.991725 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8144b497-fe85-4fb9-b6b4-22ac9b4904e7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:06:59.993886 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:59.994487 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:00.001676 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8144b497-fe85-4fb9-b6b4-22ac9b4904e7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:00.002171 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8144b497-fe85-4fb9-b6b4-22ac9b4904e7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:00.002611 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8144b497-fe85-4fb9-b6b4-22ac9b4904e7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:00.003995 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8144b497-fe85-4fb9-b6b4-22ac9b4904e7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:00.004491 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8144b497-fe85-4fb9-b6b4-22ac9b4904e7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:00.004922 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8144b497-fe85-4fb9-b6b4-22ac9b4904e7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:00.092531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-8144b497-fe85-4fb9-b6b4-22ac9b4904e7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lazy-loading 'services' on Instance uuid f017099d-af5d-452b-b828-9b231302e0c6 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:07:00.180190 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8144b497-fe85-4fb9-b6b4-22ac9b4904e7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6/os-volume_attachments/35c9a59f-9c09-4455-82db-f54bd34b526a" status: 202 len: 0 microversion: 2.1 time: 0.193609 Aug 24 09:07:00.180811 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 591/1230] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 24 09:06:59 2022] DELETE /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6/os-volume_attachments/35c9a59f-9c09-4455-82db-f54bd34b526a => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:07:01.303235 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-11f6f10b-3d47-4317-b518-5816f504c4cb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:01.303811 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-11f6f10b-3d47-4317-b518-5816f504c4cb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:01.306458 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:01.307125 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:01.312624 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11f6f10b-3d47-4317-b518-5816f504c4cb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:01.313116 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11f6f10b-3d47-4317-b518-5816f504c4cb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:01.313555 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11f6f10b-3d47-4317-b518-5816f504c4cb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:01.314251 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11f6f10b-3d47-4317-b518-5816f504c4cb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:01.314736 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11f6f10b-3d47-4317-b518-5816f504c4cb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:01.315701 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11f6f10b-3d47-4317-b518-5816f504c4cb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:01.343716 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-11f6f10b-3d47-4317-b518-5816f504c4cb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:07:01.421361 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-11f6f10b-3d47-4317-b518-5816f504c4cb tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 204 len: 0 microversion: 2.1 time: 0.122021 Aug 24 09:07:01.422071 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 640/1231] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:07:01 2022] DELETE /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:07:01.432110 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-52922b3a-b842-411b-a744-e9c1cba6406f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:01.432828 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-52922b3a-b842-411b-a744-e9c1cba6406f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:01.439256 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52922b3a-b842-411b-a744-e9c1cba6406f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:01.439741 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52922b3a-b842-411b-a744-e9c1cba6406f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:01.440255 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52922b3a-b842-411b-a744-e9c1cba6406f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:01.441117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52922b3a-b842-411b-a744-e9c1cba6406f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:01.441576 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52922b3a-b842-411b-a744-e9c1cba6406f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:01.442002 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-52922b3a-b842-411b-a744-e9c1cba6406f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:01.577063 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-52922b3a-b842-411b-a744-e9c1cba6406f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:01.585345 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-52922b3a-b842-411b-a744-e9c1cba6406f tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 200 len: 1513 microversion: 2.1 time: 0.158007 Aug 24 09:07:01.585901 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 592/1232] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:01 2022] GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:02.607006 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-25141255-0184-44d5-a7fd-49e157b4ee1b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:02.607712 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-25141255-0184-44d5-a7fd-49e157b4ee1b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:02.614270 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25141255-0184-44d5-a7fd-49e157b4ee1b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:02.614761 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25141255-0184-44d5-a7fd-49e157b4ee1b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:02.615197 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25141255-0184-44d5-a7fd-49e157b4ee1b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:02.615894 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25141255-0184-44d5-a7fd-49e157b4ee1b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:02.616380 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25141255-0184-44d5-a7fd-49e157b4ee1b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:02.616805 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-25141255-0184-44d5-a7fd-49e157b4ee1b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:02.771521 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-25141255-0184-44d5-a7fd-49e157b4ee1b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:02.780391 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-25141255-0184-44d5-a7fd-49e157b4ee1b tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 200 len: 1513 microversion: 2.1 time: 0.177730 Aug 24 09:07:02.780946 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 641/1233] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:02 2022] GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:03.801623 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-71793e60-ac52-4aeb-a4f2-79e5af52e7c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:03.802245 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-71793e60-ac52-4aeb-a4f2-79e5af52e7c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:03.808717 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71793e60-ac52-4aeb-a4f2-79e5af52e7c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:03.809208 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71793e60-ac52-4aeb-a4f2-79e5af52e7c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:03.809651 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71793e60-ac52-4aeb-a4f2-79e5af52e7c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:03.810566 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71793e60-ac52-4aeb-a4f2-79e5af52e7c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:03.810806 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71793e60-ac52-4aeb-a4f2-79e5af52e7c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:03.811235 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-71793e60-ac52-4aeb-a4f2-79e5af52e7c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:03.947909 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-71793e60-ac52-4aeb-a4f2-79e5af52e7c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45d5f4ba3284323bb58bb90625ae94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4a52a4c3744faca37f92db4493357a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:03.956941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-71793e60-ac52-4aeb-a4f2-79e5af52e7c7 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 200 len: 1513 microversion: 2.1 time: 0.159789 Aug 24 09:07:03.957857 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 593/1234] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:03 2022] GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:04.444887 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-50c205e7-fe42-490d-b817-b3b0c85f54a9 req-91059ccd-d382-4092-855d-1fa12edc368c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f017099d-af5d-452b-b828-9b231302e0c6", "name": "network-vif-deleted", "tag": "e4e1ec9d-eba1-4204-87ef-047a4f022151"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:07:04.455211 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-50c205e7-fe42-490d-b817-b3b0c85f54a9 req-91059ccd-d382-4092-855d-1fa12edc368c service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:04.455802 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-50c205e7-fe42-490d-b817-b3b0c85f54a9 req-91059ccd-d382-4092-855d-1fa12edc368c service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:04.456268 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-50c205e7-fe42-490d-b817-b3b0c85f54a9 req-91059ccd-d382-4092-855d-1fa12edc368c service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:04.467491 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-50c205e7-fe42-490d-b817-b3b0c85f54a9 req-91059ccd-d382-4092-855d-1fa12edc368c service nova] Creating event network-vif-deleted:e4e1ec9d-eba1-4204-87ef-047a4f022151 for instance f017099d-af5d-452b-b828-9b231302e0c6 on hv-cinder-83538 Aug 24 09:07:04.473547 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-50c205e7-fe42-490d-b817-b3b0c85f54a9 req-91059ccd-d382-4092-855d-1fa12edc368c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032357 Aug 24 09:07:04.474315 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 642/1235] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:07:04.979067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0fdcb3b9-79f7-4205-ba1b-98de56936499 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:04.979669 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0fdcb3b9-79f7-4205-ba1b-98de56936499 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] [instance: f017099d-af5d-452b-b828-9b231302e0c6] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:04.986320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fdcb3b9-79f7-4205-ba1b-98de56936499 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:04.986851 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fdcb3b9-79f7-4205-ba1b-98de56936499 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:04.987280 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fdcb3b9-79f7-4205-ba1b-98de56936499 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:04.987969 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fdcb3b9-79f7-4205-ba1b-98de56936499 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:04.988460 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fdcb3b9-79f7-4205-ba1b-98de56936499 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:04.988880 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0fdcb3b9-79f7-4205-ba1b-98de56936499 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:05.002855 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-0fdcb3b9-79f7-4205-ba1b-98de56936499 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] HTTP exception thrown: Instance f017099d-af5d-452b-b828-9b231302e0c6 could not be found. Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0fdcb3b9-79f7-4205-ba1b-98de56936499 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Request method failure captured: Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 HTTP/1.1 Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBemQHzOzj4KxBzetQGMfmq7_X6TWVqLDKJXTZetM_TNhPRz3HbIKRNG8nLT_fYLbZ0WunmelvlA8zdVAyDsDUUtaFGpwoArdOwtIvMU0bCcuUSsEX5FvN69pNa7OBf_s7h-Fe2tHGBZ7E8o_uQcThg1xc1qtY67ZTaofeNtLw4ruYfk Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 3e4a52a4c3744faca37f92db4493357a Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2011180662 Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:07:05.004504 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:07:05.006068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3e4a52a4c3744faca37f92db4493357a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3e4a52a4c3744faca37f92db4493357a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e4a52a4c3744faca37f92db4493357a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3e4a52a4c3744faca37f92db4493357a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:07:05.006068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-VolumesSnapshotTestJSON-2011180662 Aug 24 09:07:05.006068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 3e4a52a4c3744faca37f92db4493357a Aug 24 09:07:05.006068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2011180662 Aug 24 09:07:05.006068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-VolumesSnapshotTestJSON-2011180662-project Aug 24 09:07:05.006068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:07:05.006068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:07:05.006068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: a45d5f4ba3284323bb58bb90625ae94f Aug 24 09:07:05.006068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-VolumesSnapshotTestJSON-2011180662-project Aug 24 09:07:05.006068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:07:05.006068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance f017099d-af5d-452b-b828-9b231302e0c6 could not be found. Aug 24 09:07:05.006068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': 'f017099d-af5d-452b-b828-9b231302e0c6'} Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f017099d-af5d-452b-b828-9b231302e0c6 could not be found. Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:07:05.006947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f017099d-af5d-452b-b828-9b231302e0c6 could not be found. Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f017099d-af5d-452b-b828-9b231302e0c6 could not be found. Aug 24 09:07:05.008531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:07:05.010077 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0fdcb3b9-79f7-4205-ba1b-98de56936499 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] Returning 404 to user: Instance f017099d-af5d-452b-b828-9b231302e0c6 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:07:05.010077 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0fdcb3b9-79f7-4205-ba1b-98de56936499 tempest-VolumesSnapshotTestJSON-2011180662 tempest-VolumesSnapshotTestJSON-2011180662-project] 10.222.0.67 "GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6" status: 404 len: 111 microversion: 2.1 time: 0.031645 Aug 24 09:07:05.010077 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 594/1236] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:04 2022] GET /compute/v2.1/servers/f017099d-af5d-452b-b828-9b231302e0c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:07:08.943521 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1640d928-fa34-4a7b-8e72-373ff1c636b5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:08.944116 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1640d928-fa34-4a7b-8e72-373ff1c636b5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:08.945002 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-6942d015-e98c-454a-9a84-71fafc5c7f2c req-d50d26b0-9bd7-499b-a734-f9e0900b5bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4056ca-2520-4b9f-8d6f-818005b9a13e", "tag": "4e9c44c6-d08e-40f7-8605-73a851811f32"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:07:08.950335 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1640d928-fa34-4a7b-8e72-373ff1c636b5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:08.950829 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1640d928-fa34-4a7b-8e72-373ff1c636b5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:08.951287 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1640d928-fa34-4a7b-8e72-373ff1c636b5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:08.951960 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1640d928-fa34-4a7b-8e72-373ff1c636b5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:08.952435 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1640d928-fa34-4a7b-8e72-373ff1c636b5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:08.952856 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1640d928-fa34-4a7b-8e72-373ff1c636b5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:08.957380 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6942d015-e98c-454a-9a84-71fafc5c7f2c req-d50d26b0-9bd7-499b-a734-f9e0900b5bce service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:08.958028 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6942d015-e98c-454a-9a84-71fafc5c7f2c req-d50d26b0-9bd7-499b-a734-f9e0900b5bce service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:08.958582 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-6942d015-e98c-454a-9a84-71fafc5c7f2c req-d50d26b0-9bd7-499b-a734-f9e0900b5bce service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:08.971289 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-6942d015-e98c-454a-9a84-71fafc5c7f2c req-d50d26b0-9bd7-499b-a734-f9e0900b5bce service nova] Creating event network-changed:4e9c44c6-d08e-40f7-8605-73a851811f32 for instance 8c4056ca-2520-4b9f-8d6f-818005b9a13e on hv-cinder-83538 Aug 24 09:07:08.976947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-6942d015-e98c-454a-9a84-71fafc5c7f2c req-d50d26b0-9bd7-499b-a734-f9e0900b5bce service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035843 Aug 24 09:07:08.977585 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 595/1237] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:07:08.980006 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1640d928-fa34-4a7b-8e72-373ff1c636b5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:07:09.059249 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1640d928-fa34-4a7b-8e72-373ff1c636b5 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 204 len: 0 microversion: 2.1 time: 0.120189 Aug 24 09:07:09.059837 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 643/1238] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:07:08 2022] DELETE /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:07:09.068948 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-35b19989-d6ed-4cbf-968a-8554ce468009 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:09.069651 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-35b19989-d6ed-4cbf-968a-8554ce468009 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:09.075995 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35b19989-d6ed-4cbf-968a-8554ce468009 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:09.076854 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35b19989-d6ed-4cbf-968a-8554ce468009 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:09.077053 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35b19989-d6ed-4cbf-968a-8554ce468009 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:09.077633 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35b19989-d6ed-4cbf-968a-8554ce468009 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:09.078100 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35b19989-d6ed-4cbf-968a-8554ce468009 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:09.079076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-35b19989-d6ed-4cbf-968a-8554ce468009 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:09.225029 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-35b19989-d6ed-4cbf-968a-8554ce468009 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:09.233137 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-35b19989-d6ed-4cbf-968a-8554ce468009 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1566 microversion: 2.1 time: 0.168460 Aug 24 09:07:09.233706 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 596/1239] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:09 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:07:10.254721 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3bc2ede9-6b31-4bda-8f80-9f04645854bf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:10.255460 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3bc2ede9-6b31-4bda-8f80-9f04645854bf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:10.261930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bc2ede9-6b31-4bda-8f80-9f04645854bf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:10.262420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bc2ede9-6b31-4bda-8f80-9f04645854bf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:10.262862 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bc2ede9-6b31-4bda-8f80-9f04645854bf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:10.263558 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bc2ede9-6b31-4bda-8f80-9f04645854bf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:10.264019 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bc2ede9-6b31-4bda-8f80-9f04645854bf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:10.264480 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3bc2ede9-6b31-4bda-8f80-9f04645854bf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:10.400571 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3bc2ede9-6b31-4bda-8f80-9f04645854bf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:10.409022 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3bc2ede9-6b31-4bda-8f80-9f04645854bf tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1566 microversion: 2.1 time: 0.158563 Aug 24 09:07:10.409527 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 644/1240] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:10 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:11.430953 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5ea6dd3f-b682-4a91-a794-bb04bc0c956a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:11.431622 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5ea6dd3f-b682-4a91-a794-bb04bc0c956a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:11.439050 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ea6dd3f-b682-4a91-a794-bb04bc0c956a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:11.439547 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ea6dd3f-b682-4a91-a794-bb04bc0c956a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:11.439987 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ea6dd3f-b682-4a91-a794-bb04bc0c956a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:11.440732 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ea6dd3f-b682-4a91-a794-bb04bc0c956a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:11.441195 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ea6dd3f-b682-4a91-a794-bb04bc0c956a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:11.441628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ea6dd3f-b682-4a91-a794-bb04bc0c956a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:11.579032 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5ea6dd3f-b682-4a91-a794-bb04bc0c956a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:11.586875 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5ea6dd3f-b682-4a91-a794-bb04bc0c956a tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1566 microversion: 2.1 time: 0.159866 Aug 24 09:07:11.587434 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 597/1241] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:11 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:12.608515 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-bcdad3c8-0c14-4aee-86d3-3f6a328978aa tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:12.609226 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-bcdad3c8-0c14-4aee-86d3-3f6a328978aa tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:12.615812 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcdad3c8-0c14-4aee-86d3-3f6a328978aa tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:12.616346 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcdad3c8-0c14-4aee-86d3-3f6a328978aa tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:12.616790 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcdad3c8-0c14-4aee-86d3-3f6a328978aa tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:12.617483 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcdad3c8-0c14-4aee-86d3-3f6a328978aa tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:12.617945 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcdad3c8-0c14-4aee-86d3-3f6a328978aa tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:12.618377 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-bcdad3c8-0c14-4aee-86d3-3f6a328978aa tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:12.761260 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-bcdad3c8-0c14-4aee-86d3-3f6a328978aa tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:12.769393 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-bcdad3c8-0c14-4aee-86d3-3f6a328978aa tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1448 microversion: 2.1 time: 0.164831 Aug 24 09:07:12.769980 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 645/1242] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:12 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1448 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:13.350947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-13f0237d-3c96-42e5-9a8c-aed4890ae62c req-c3fad66a-99e0-43e1-af31-bea3035870b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4056ca-2520-4b9f-8d6f-818005b9a13e", "name": "network-vif-deleted", "tag": "4e9c44c6-d08e-40f7-8605-73a851811f32"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:07:13.362646 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-13f0237d-3c96-42e5-9a8c-aed4890ae62c req-c3fad66a-99e0-43e1-af31-bea3035870b9 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:13.363151 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-13f0237d-3c96-42e5-9a8c-aed4890ae62c req-c3fad66a-99e0-43e1-af31-bea3035870b9 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:13.363636 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-13f0237d-3c96-42e5-9a8c-aed4890ae62c req-c3fad66a-99e0-43e1-af31-bea3035870b9 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:13.375559 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-13f0237d-3c96-42e5-9a8c-aed4890ae62c req-c3fad66a-99e0-43e1-af31-bea3035870b9 service nova] Creating event network-vif-deleted:4e9c44c6-d08e-40f7-8605-73a851811f32 for instance 8c4056ca-2520-4b9f-8d6f-818005b9a13e on hv-cinder-83538 Aug 24 09:07:13.380411 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-13f0237d-3c96-42e5-9a8c-aed4890ae62c req-c3fad66a-99e0-43e1-af31-bea3035870b9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033496 Aug 24 09:07:13.381355 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 598/1243] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:07:13.790170 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2a276d4d-dc7d-4e94-bcb0-460212f54799 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:13.791323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2a276d4d-dc7d-4e94-bcb0-460212f54799 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:13.802431 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a276d4d-dc7d-4e94-bcb0-460212f54799 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:13.803158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a276d4d-dc7d-4e94-bcb0-460212f54799 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:13.803766 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a276d4d-dc7d-4e94-bcb0-460212f54799 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:13.812707 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a276d4d-dc7d-4e94-bcb0-460212f54799 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:13.815291 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a276d4d-dc7d-4e94-bcb0-460212f54799 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:13.816728 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a276d4d-dc7d-4e94-bcb0-460212f54799 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:13.859136 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a276d4d-dc7d-4e94-bcb0-460212f54799 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:13.859616 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a276d4d-dc7d-4e94-bcb0-460212f54799 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:13.860083 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2a276d4d-dc7d-4e94-bcb0-460212f54799 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:13.860619 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-2a276d4d-dc7d-4e94-bcb0-460212f54799 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lazy-loading 'fault' on Instance uuid 8c4056ca-2520-4b9f-8d6f-818005b9a13e {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:07:13.903008 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2a276d4d-dc7d-4e94-bcb0-460212f54799 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc56fc598e741ceab98edd3b9afa28c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d68ee6e33664bbfba3b239f16fbbaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:13.911052 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2a276d4d-dc7d-4e94-bcb0-460212f54799 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 200 len: 1223 microversion: 2.1 time: 0.124834 Aug 24 09:07:13.911619 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 646/1244] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:13 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 1223 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:07:14.933188 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-341f7c9f-3789-4bcc-8800-34c9d7a050f9 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:14.933968 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-341f7c9f-3789-4bcc-8800-34c9d7a050f9 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] [instance: 8c4056ca-2520-4b9f-8d6f-818005b9a13e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:14.940425 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-341f7c9f-3789-4bcc-8800-34c9d7a050f9 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:14.940996 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-341f7c9f-3789-4bcc-8800-34c9d7a050f9 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:14.941516 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-341f7c9f-3789-4bcc-8800-34c9d7a050f9 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:14.942220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-341f7c9f-3789-4bcc-8800-34c9d7a050f9 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:14.942682 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-341f7c9f-3789-4bcc-8800-34c9d7a050f9 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:14.943114 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-341f7c9f-3789-4bcc-8800-34c9d7a050f9 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:14.957240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-341f7c9f-3789-4bcc-8800-34c9d7a050f9 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] HTTP exception thrown: Instance 8c4056ca-2520-4b9f-8d6f-818005b9a13e could not be found. Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-341f7c9f-3789-4bcc-8800-34c9d7a050f9 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Request method failure captured: Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e HTTP/1.1 Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeie0n__Fd4wDMpU9oYcG-OlsRLX207_yxAfaA_AsKqhGCAv2ceOh9Zx8IkMVOxjr56pYVJE4jDp5tZNOKVf8uIHaGSBQKi_1tJnYZW_dybBUP0bvGxzbLmr3BpWquiozeVRPZI8Gq2tLRFM8ppUDeFCMhdtYYEijARsqaysKIKoF-4 Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 3d68ee6e33664bbfba3b239f16fbbaa0 Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-TestShelveInstance-1936492635 Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:07:14.958914 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:07:14.960610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3d68ee6e33664bbfba3b239f16fbbaa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3d68ee6e33664bbfba3b239f16fbbaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3d68ee6e33664bbfba3b239f16fbbaa0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3d68ee6e33664bbfba3b239f16fbbaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:07:14.960610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-TestShelveInstance-1936492635 Aug 24 09:07:14.960610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 3d68ee6e33664bbfba3b239f16fbbaa0 Aug 24 09:07:14.960610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestShelveInstance-1936492635 Aug 24 09:07:14.960610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-TestShelveInstance-1936492635-project Aug 24 09:07:14.960610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:07:14.960610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:07:14.960610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: edc56fc598e741ceab98edd3b9afa28c Aug 24 09:07:14.960610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-TestShelveInstance-1936492635-project Aug 24 09:07:14.960610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:07:14.960610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance 8c4056ca-2520-4b9f-8d6f-818005b9a13e could not be found. Aug 24 09:07:14.960610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': '8c4056ca-2520-4b9f-8d6f-818005b9a13e'} Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4056ca-2520-4b9f-8d6f-818005b9a13e could not be found. Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:07:14.961554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4056ca-2520-4b9f-8d6f-818005b9a13e could not be found. Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4056ca-2520-4b9f-8d6f-818005b9a13e could not be found. Aug 24 09:07:14.963512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:07:14.964868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-341f7c9f-3789-4bcc-8800-34c9d7a050f9 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Returning 404 to user: Instance 8c4056ca-2520-4b9f-8d6f-818005b9a13e could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:07:14.964868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-341f7c9f-3789-4bcc-8800-34c9d7a050f9 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e" status: 404 len: 111 microversion: 2.1 time: 0.031997 Aug 24 09:07:14.964868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 599/1245] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:14 2022] GET /compute/v2.1/servers/8c4056ca-2520-4b9f-8d6f-818005b9a13e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:07:15.134994 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cd712826-40f1-4719-b322-321f2dcc6c43 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] Calling method '.version_select at 0x7fb140ef83a0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:15.159595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cd712826-40f1-4719-b322-321f2dcc6c43 tempest-TestShelveInstance-1936492635 tempest-TestShelveInstance-1936492635-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-333958261" status: 202 len: 0 microversion: 2.1 time: 0.028314 Aug 24 09:07:15.160399 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 647/1246] 10.222.0.67 () {58 vars in 1251 bytes} [Wed Aug 24 09:07:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-333958261 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:07:20.701800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:07:20.702416 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Wed Aug 24 09:07:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:07:47.542403 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=18 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:47.543491 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:47.763682 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cb26924e-dc53-4164-8cb4-3bffa3824dfe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:47.764302 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cb26924e-dc53-4164-8cb4-3bffa3824dfe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:47.770636 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb26924e-dc53-4164-8cb4-3bffa3824dfe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:47.771202 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb26924e-dc53-4164-8cb4-3bffa3824dfe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:47.771635 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb26924e-dc53-4164-8cb4-3bffa3824dfe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:47.772540 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb26924e-dc53-4164-8cb4-3bffa3824dfe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:47.773083 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb26924e-dc53-4164-8cb4-3bffa3824dfe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:47.775009 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cb26924e-dc53-4164-8cb4-3bffa3824dfe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:47.802669 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cb26924e-dc53-4164-8cb4-3bffa3824dfe tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9/ips" status: 200 len: 147 microversion: 2.1 time: 0.266102 Aug 24 09:07:47.803224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 600/1247] 10.222.0.67 () {58 vars in 1248 bytes} [Wed Aug 24 09:07:47 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9/ips => generated 147 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:07:49.197158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:49.198036 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:49.202563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-85f2a681-8520-4aad-9832-a5452a8be363 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9394c2d6-488a-4fbc-8870-ebccdf5d0733"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:07:49.205667 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-85f2a681-8520-4aad-9832-a5452a8be363 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:49.215204 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85f2a681-8520-4aad-9832-a5452a8be363 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:49.215688 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85f2a681-8520-4aad-9832-a5452a8be363 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:49.216142 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85f2a681-8520-4aad-9832-a5452a8be363 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:49.216845 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85f2a681-8520-4aad-9832-a5452a8be363 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:49.217293 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85f2a681-8520-4aad-9832-a5452a8be363 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:49.217710 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85f2a681-8520-4aad-9832-a5452a8be363 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:49.487116 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-85f2a681-8520-4aad-9832-a5452a8be363 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "POST /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291896 Aug 24 09:07:49.487992 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 648/1248] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 24 09:07:49 2022] POST /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:07:57.169457 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-812b69ba-13ad-4d57-8762-b48ed548dca4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:57.169998 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-812b69ba-13ad-4d57-8762-b48ed548dca4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:57.176068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-812b69ba-13ad-4d57-8762-b48ed548dca4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:57.176576 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-812b69ba-13ad-4d57-8762-b48ed548dca4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:57.177009 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-812b69ba-13ad-4d57-8762-b48ed548dca4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:57.177979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-812b69ba-13ad-4d57-8762-b48ed548dca4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:57.178431 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-812b69ba-13ad-4d57-8762-b48ed548dca4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:57.178874 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-812b69ba-13ad-4d57-8762-b48ed548dca4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:57.260144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-812b69ba-13ad-4d57-8762-b48ed548dca4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lazy-loading 'services' on Instance uuid 19c4f039-665a-4517-b881-a573445044f9 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:07:57.331842 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-812b69ba-13ad-4d57-8762-b48ed548dca4 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "DELETE /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9/os-volume_attachments/9394c2d6-488a-4fbc-8870-ebccdf5d0733" status: 202 len: 0 microversion: 2.1 time: 0.166203 Aug 24 09:07:57.332455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 601/1249] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 24 09:07:57 2022] DELETE /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9/os-volume_attachments/9394c2d6-488a-4fbc-8870-ebccdf5d0733 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:07:57.342563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-14c83d58-57ac-424f-81a0-943ff0678565 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:57.344975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-14c83d58-57ac-424f-81a0-943ff0678565 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:57.353104 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14c83d58-57ac-424f-81a0-943ff0678565 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:57.353683 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14c83d58-57ac-424f-81a0-943ff0678565 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:57.354195 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14c83d58-57ac-424f-81a0-943ff0678565 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:57.355020 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14c83d58-57ac-424f-81a0-943ff0678565 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:57.355482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14c83d58-57ac-424f-81a0-943ff0678565 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:57.355911 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14c83d58-57ac-424f-81a0-943ff0678565 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:57.387589 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-14c83d58-57ac-424f-81a0-943ff0678565 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049789 Aug 24 09:07:57.388163 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 649/1250] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:07:57 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:07:58.403550 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d87d7ec2-7b47-4d75-9ba4-93f0e5d7e742 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:58.404170 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d87d7ec2-7b47-4d75-9ba4-93f0e5d7e742 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:58.410173 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87d7ec2-7b47-4d75-9ba4-93f0e5d7e742 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:58.410653 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87d7ec2-7b47-4d75-9ba4-93f0e5d7e742 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:58.411483 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87d7ec2-7b47-4d75-9ba4-93f0e5d7e742 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:58.412074 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87d7ec2-7b47-4d75-9ba4-93f0e5d7e742 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:58.412723 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87d7ec2-7b47-4d75-9ba4-93f0e5d7e742 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:58.413580 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d87d7ec2-7b47-4d75-9ba4-93f0e5d7e742 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:58.443493 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d87d7ec2-7b47-4d75-9ba4-93f0e5d7e742 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047860 Aug 24 09:07:58.444047 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 602/1251] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:07:58 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:07:58.511706 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-1bd141c9-fc6e-4969-9b73-a5afe02a7e45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:58.512331 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1bd141c9-fc6e-4969-9b73-a5afe02a7e45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:58.520209 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bd141c9-fc6e-4969-9b73-a5afe02a7e45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:58.520695 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bd141c9-fc6e-4969-9b73-a5afe02a7e45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:58.521160 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bd141c9-fc6e-4969-9b73-a5afe02a7e45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:58.521860 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bd141c9-fc6e-4969-9b73-a5afe02a7e45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:58.522308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bd141c9-fc6e-4969-9b73-a5afe02a7e45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:58.522726 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-1bd141c9-fc6e-4969-9b73-a5afe02a7e45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:58.548442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-1bd141c9-fc6e-4969-9b73-a5afe02a7e45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:07:58.627419 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-1bd141c9-fc6e-4969-9b73-a5afe02a7e45 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "DELETE /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 204 len: 0 microversion: 2.1 time: 0.119254 Aug 24 09:07:58.628415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 650/1252] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:07:58 2022] DELETE /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:07:58.637395 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-abf3e60b-e98d-4abb-8883-88afd4866e74 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:58.638018 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-abf3e60b-e98d-4abb-8883-88afd4866e74 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:58.644324 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abf3e60b-e98d-4abb-8883-88afd4866e74 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:58.644818 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abf3e60b-e98d-4abb-8883-88afd4866e74 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:58.645258 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abf3e60b-e98d-4abb-8883-88afd4866e74 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:58.645993 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abf3e60b-e98d-4abb-8883-88afd4866e74 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:58.646454 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abf3e60b-e98d-4abb-8883-88afd4866e74 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:58.647076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-abf3e60b-e98d-4abb-8883-88afd4866e74 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:58.790426 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-abf3e60b-e98d-4abb-8883-88afd4866e74 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:58.798193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-abf3e60b-e98d-4abb-8883-88afd4866e74 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 200 len: 1676 microversion: 2.1 time: 0.164708 Aug 24 09:07:58.798753 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 603/1253] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:58 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:07:59.821944 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-505d7d06-7335-4c0a-8bb4-7d399a0a0b24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:07:59.822646 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-505d7d06-7335-4c0a-8bb4-7d399a0a0b24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:07:59.829143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505d7d06-7335-4c0a-8bb4-7d399a0a0b24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:59.829625 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505d7d06-7335-4c0a-8bb4-7d399a0a0b24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:59.830063 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505d7d06-7335-4c0a-8bb4-7d399a0a0b24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:59.830755 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505d7d06-7335-4c0a-8bb4-7d399a0a0b24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:07:59.831212 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505d7d06-7335-4c0a-8bb4-7d399a0a0b24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:07:59.831632 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-505d7d06-7335-4c0a-8bb4-7d399a0a0b24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:07:59.964995 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-505d7d06-7335-4c0a-8bb4-7d399a0a0b24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:07:59.972730 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-505d7d06-7335-4c0a-8bb4-7d399a0a0b24 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 200 len: 1676 microversion: 2.1 time: 0.155127 Aug 24 09:07:59.973300 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 651/1254] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:07:59 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:00.995580 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8d7f8e04-5a29-444f-b7b6-3518ec5352a8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:00.996206 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8d7f8e04-5a29-444f-b7b6-3518ec5352a8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:01.003170 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d7f8e04-5a29-444f-b7b6-3518ec5352a8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:01.003923 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d7f8e04-5a29-444f-b7b6-3518ec5352a8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:01.004391 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d7f8e04-5a29-444f-b7b6-3518ec5352a8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:01.006550 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d7f8e04-5a29-444f-b7b6-3518ec5352a8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:01.007352 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d7f8e04-5a29-444f-b7b6-3518ec5352a8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:01.008078 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8d7f8e04-5a29-444f-b7b6-3518ec5352a8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:01.262264 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8d7f8e04-5a29-444f-b7b6-3518ec5352a8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:01.270015 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8d7f8e04-5a29-444f-b7b6-3518ec5352a8 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 200 len: 1676 microversion: 2.1 time: 0.278405 Aug 24 09:08:01.271621 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 604/1255] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:00 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 1676 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:08:01.853945 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-0851d44b-4b51-4c05-b85d-596d13cfea7b req-72671dae-1479-46f7-b7ab-4783a05bd582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c4f039-665a-4517-b881-a573445044f9", "name": "network-vif-deleted", "tag": "238d5301-2a72-4f87-b032-af7b25cb6e2d"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:08:01.868280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0851d44b-4b51-4c05-b85d-596d13cfea7b req-72671dae-1479-46f7-b7ab-4783a05bd582 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:01.869550 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0851d44b-4b51-4c05-b85d-596d13cfea7b req-72671dae-1479-46f7-b7ab-4783a05bd582 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:01.870451 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-0851d44b-4b51-4c05-b85d-596d13cfea7b req-72671dae-1479-46f7-b7ab-4783a05bd582 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:01.887497 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-0851d44b-4b51-4c05-b85d-596d13cfea7b req-72671dae-1479-46f7-b7ab-4783a05bd582 service nova] Creating event network-vif-deleted:238d5301-2a72-4f87-b032-af7b25cb6e2d for instance 19c4f039-665a-4517-b881-a573445044f9 on hv-cinder-83538 Aug 24 09:08:01.893273 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-0851d44b-4b51-4c05-b85d-596d13cfea7b req-72671dae-1479-46f7-b7ab-4783a05bd582 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045223 Aug 24 09:08:01.893943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 652/1256] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:08:02.295080 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b7da6d0e-e9eb-4b4b-a823-b4c137951587 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:02.296632 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b7da6d0e-e9eb-4b4b-a823-b4c137951587 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:02.307549 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7da6d0e-e9eb-4b4b-a823-b4c137951587 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:02.308349 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7da6d0e-e9eb-4b4b-a823-b4c137951587 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:02.309048 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7da6d0e-e9eb-4b4b-a823-b4c137951587 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:02.310794 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7da6d0e-e9eb-4b4b-a823-b4c137951587 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:02.312081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7da6d0e-e9eb-4b4b-a823-b4c137951587 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:02.313490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7da6d0e-e9eb-4b4b-a823-b4c137951587 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:02.361754 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7da6d0e-e9eb-4b4b-a823-b4c137951587 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:02.362661 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7da6d0e-e9eb-4b4b-a823-b4c137951587 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:02.363326 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b7da6d0e-e9eb-4b4b-a823-b4c137951587 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:02.364701 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-b7da6d0e-e9eb-4b4b-a823-b4c137951587 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lazy-loading 'fault' on Instance uuid 19c4f039-665a-4517-b881-a573445044f9 {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:08:02.418856 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-b7da6d0e-e9eb-4b4b-a823-b4c137951587 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0929f371e4442eb4eb6e12a96bbfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6183eeb3ff43e79eccb5d7ad08c53c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:02.426216 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b7da6d0e-e9eb-4b4b-a823-b4c137951587 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 200 len: 1329 microversion: 2.1 time: 0.135581 Aug 24 09:08:02.426834 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 605/1257] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:02 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 1329 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:02.853945 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c672ea7a-1741-4bcf-911e-3de1b1049538 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:02.855980 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c672ea7a-1741-4bcf-911e-3de1b1049538 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:02.863110 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c672ea7a-1741-4bcf-911e-3de1b1049538 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:02.863601 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c672ea7a-1741-4bcf-911e-3de1b1049538 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:02.864041 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c672ea7a-1741-4bcf-911e-3de1b1049538 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:02.864923 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c672ea7a-1741-4bcf-911e-3de1b1049538 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:02.865379 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c672ea7a-1741-4bcf-911e-3de1b1049538 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:02.865804 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c672ea7a-1741-4bcf-911e-3de1b1049538 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:02.902990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c672ea7a-1741-4bcf-911e-3de1b1049538 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054775 Aug 24 09:08:02.903632 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 653/1258] 10.222.0.67 () {60 vars in 1343 bytes} [Wed Aug 24 09:08:02 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:08:02.973335 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0d5a9771-61b9-49b3-9268-12a661b083cd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:02.974171 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d5a9771-61b9-49b3-9268-12a661b083cd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:02.980470 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d5a9771-61b9-49b3-9268-12a661b083cd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:02.980977 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d5a9771-61b9-49b3-9268-12a661b083cd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:02.981520 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d5a9771-61b9-49b3-9268-12a661b083cd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:02.982241 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d5a9771-61b9-49b3-9268-12a661b083cd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:02.982870 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d5a9771-61b9-49b3-9268-12a661b083cd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:02.983308 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0d5a9771-61b9-49b3-9268-12a661b083cd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:03.012564 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0d5a9771-61b9-49b3-9268-12a661b083cd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:08:03.135300 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0d5a9771-61b9-49b3-9268-12a661b083cd tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 204 len: 0 microversion: 2.20 time: 0.165554 Aug 24 09:08:03.135991 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 606/1259] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 24 09:08:02 2022] DELETE /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 09:08:03.152221 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cd90e42f-0c86-4601-91b9-396a369545a2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:03.154461 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cd90e42f-0c86-4601-91b9-396a369545a2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:03.180084 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd90e42f-0c86-4601-91b9-396a369545a2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:03.186070 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd90e42f-0c86-4601-91b9-396a369545a2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:03.186849 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd90e42f-0c86-4601-91b9-396a369545a2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:03.187609 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd90e42f-0c86-4601-91b9-396a369545a2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:03.188288 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd90e42f-0c86-4601-91b9-396a369545a2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:03.188508 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd90e42f-0c86-4601-91b9-396a369545a2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:03.378320 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cd90e42f-0c86-4601-91b9-396a369545a2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:03.388728 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cd90e42f-0c86-4601-91b9-396a369545a2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:03.390391 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-cd90e42f-0c86-4601-91b9-396a369545a2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:03.391712 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cd90e42f-0c86-4601-91b9-396a369545a2 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.248819 Aug 24 09:08:03.392352 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 654/1260] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:08:03 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:08:03.452597 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32b452ec-a3a4-4729-a758-67bfb528c0de tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:03.453429 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-32b452ec-a3a4-4729-a758-67bfb528c0de tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:03.461014 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b452ec-a3a4-4729-a758-67bfb528c0de tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:03.461512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b452ec-a3a4-4729-a758-67bfb528c0de tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:03.461951 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b452ec-a3a4-4729-a758-67bfb528c0de tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:03.462906 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b452ec-a3a4-4729-a758-67bfb528c0de tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:03.463486 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b452ec-a3a4-4729-a758-67bfb528c0de tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:03.463890 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32b452ec-a3a4-4729-a758-67bfb528c0de tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:03.479205 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-32b452ec-a3a4-4729-a758-67bfb528c0de tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] HTTP exception thrown: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32b452ec-a3a4-4729-a758-67bfb528c0de tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Request method failure captured: Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 HTTP/1.1 Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeebN0Zobm2z9rP6Ekh4dDHbb3SuIkLHnpc3jkEcaHX4GwAfCoUa-aKWg_1MrmPsv97hdPp9j0fQ8hJI9Rp88PNgp2Z4khPlc0lMhYOfsdGUEPCdmARxQAqvXejsu5r4s5TUgAt8jNrxZH2x0zVTldxkuHkKggh8MFCnTglnQHmP2Dw Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:08:03.480941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:08:03.482872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:08:03.482872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:03.482872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:03.482872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:03.482872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:03.482872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:08:03.482872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:08:03.482872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: bd0929f371e4442eb4eb6e12a96bbfc4 Aug 24 09:08:03.482872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:03.482872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:08:03.482872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. Aug 24 09:08:03.482872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': '19c4f039-665a-4517-b881-a573445044f9'} Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:03.484320 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. Aug 24 09:08:03.486596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:03.487988 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32b452ec-a3a4-4729-a758-67bfb528c0de tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Returning 404 to user: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:03.487988 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-32b452ec-a3a4-4729-a758-67bfb528c0de tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 404 len: 111 microversion: 2.1 time: 0.038007 Aug 24 09:08:03.487988 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 607/1261] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:03 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:08:03.496123 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-20abd15f-47dc-4866-8c4c-1fe70365754f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '.version_select at 0x7fb140ce68b0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:03.529004 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-20abd15f-47dc-4866-8c4c-1fe70365754f tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-47336056" status: 202 len: 0 microversion: 2.1 time: 0.039481 Aug 24 09:08:03.529523 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 655/1262] 10.222.0.67 () {58 vars in 1215 bytes} [Wed Aug 24 09:08:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-47336056 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:08:04.416613 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-2c56e324-806b-49d4-8b40-24683aa98c11 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:04.417371 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-2c56e324-806b-49d4-8b40-24683aa98c11 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:04.423386 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c56e324-806b-49d4-8b40-24683aa98c11 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:04.423955 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c56e324-806b-49d4-8b40-24683aa98c11 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:04.424494 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c56e324-806b-49d4-8b40-24683aa98c11 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:04.425197 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c56e324-806b-49d4-8b40-24683aa98c11 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:04.425654 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c56e324-806b-49d4-8b40-24683aa98c11 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:04.426081 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-2c56e324-806b-49d4-8b40-24683aa98c11 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:04.605693 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-2c56e324-806b-49d4-8b40-24683aa98c11 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:04.619214 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-2c56e324-806b-49d4-8b40-24683aa98c11 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:04.621851 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-2c56e324-806b-49d4-8b40-24683aa98c11 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:04.623261 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-2c56e324-806b-49d4-8b40-24683aa98c11 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1722 microversion: 2.20 time: 0.211396 Aug 24 09:08:04.624602 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 608/1263] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:08:04 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:08:05.628822 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a6f885b7-e153-4562-b2d2-be4a8edc561c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:05.629386 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-a6f885b7-e153-4562-b2d2-be4a8edc561c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:05.636078 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6f885b7-e153-4562-b2d2-be4a8edc561c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:05.636654 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6f885b7-e153-4562-b2d2-be4a8edc561c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:05.637097 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6f885b7-e153-4562-b2d2-be4a8edc561c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:05.637813 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6f885b7-e153-4562-b2d2-be4a8edc561c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:05.638254 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6f885b7-e153-4562-b2d2-be4a8edc561c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:05.638681 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-a6f885b7-e153-4562-b2d2-be4a8edc561c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:05.647204 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-9da16834-cdad-411d-9bfa-f641c1f0354e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:05.648212 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-9da16834-cdad-411d-9bfa-f641c1f0354e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:05.654833 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-a6f885b7-e153-4562-b2d2-be4a8edc561c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] HTTP exception thrown: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. Aug 24 09:08:05.656382 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9da16834-cdad-411d-9bfa-f641c1f0354e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a6f885b7-e153-4562-b2d2-be4a8edc561c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Request method failure captured: Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: DELETE /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 HTTP/1.1 Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeebN0Zobm2z9rP6Ekh4dDHbb3SuIkLHnpc3jkEcaHX4GwAfCoUa-aKWg_1MrmPsv97hdPp9j0fQ8hJI9Rp88PNgp2Z4khPlc0lMhYOfsdGUEPCdmARxQAqvXejsu5r4s5TUgAt8jNrxZH2x0zVTldxkuHkKggh8MFCnTglnQHmP2Dw Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:08:05.656630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:08:05.658217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:08:05.658217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:05.658217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:05.658217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:05.658217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:05.658217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:08:05.658217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:08:05.658217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: bd0929f371e4442eb4eb6e12a96bbfc4 Aug 24 09:08:05.658217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:05.658217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:08:05.658217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. Aug 24 09:08:05.658217 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '19c4f039-665a-4517-b881-a573445044f9'} Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:05.659834 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. Aug 24 09:08:05.662631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:05.664137 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9da16834-cdad-411d-9bfa-f641c1f0354e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:05.664264 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-a6f885b7-e153-4562-b2d2-be4a8edc561c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Returning 404 to user: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:05.664264 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-a6f885b7-e153-4562-b2d2-be4a8edc561c tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "DELETE /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 404 len: 111 microversion: 2.1 time: 0.033084 Aug 24 09:08:05.664264 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 656/1264] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:08:05 2022] DELETE /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:08:05.664529 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9da16834-cdad-411d-9bfa-f641c1f0354e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:05.664529 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9da16834-cdad-411d-9bfa-f641c1f0354e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:05.665322 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9da16834-cdad-411d-9bfa-f641c1f0354e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:05.665322 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-9da16834-cdad-411d-9bfa-f641c1f0354e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:05.668323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e55d8a1c-4f13-4a2c-a1d8-c4c53878bc97 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:05.668943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e55d8a1c-4f13-4a2c-a1d8-c4c53878bc97 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 19c4f039-665a-4517-b881-a573445044f9] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:05.675773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e55d8a1c-4f13-4a2c-a1d8-c4c53878bc97 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:05.677037 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e55d8a1c-4f13-4a2c-a1d8-c4c53878bc97 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:05.677451 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e55d8a1c-4f13-4a2c-a1d8-c4c53878bc97 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:05.678164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e55d8a1c-4f13-4a2c-a1d8-c4c53878bc97 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:05.678619 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e55d8a1c-4f13-4a2c-a1d8-c4c53878bc97 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:05.679276 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e55d8a1c-4f13-4a2c-a1d8-c4c53878bc97 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:05.693238 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-e55d8a1c-4f13-4a2c-a1d8-c4c53878bc97 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] HTTP exception thrown: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e55d8a1c-4f13-4a2c-a1d8-c4c53878bc97 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Request method failure captured: Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 HTTP/1.1 Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeebN0Zobm2z9rP6Ekh4dDHbb3SuIkLHnpc3jkEcaHX4GwAfCoUa-aKWg_1MrmPsv97hdPp9j0fQ8hJI9Rp88PNgp2Z4khPlc0lMhYOfsdGUEPCdmARxQAqvXejsu5r4s5TUgAt8jNrxZH2x0zVTldxkuHkKggh8MFCnTglnQHmP2Dw Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:08:05.694799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:08:05.696272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:08:05.696272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:05.696272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:05.696272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:05.696272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:05.696272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:08:05.696272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:08:05.696272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: bd0929f371e4442eb4eb6e12a96bbfc4 Aug 24 09:08:05.696272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:05.696272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:08:05.696272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. Aug 24 09:08:05.696272 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '19c4f039-665a-4517-b881-a573445044f9'} Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:05.697308 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. Aug 24 09:08:05.698563 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:05.699658 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e55d8a1c-4f13-4a2c-a1d8-c4c53878bc97 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Returning 404 to user: Instance 19c4f039-665a-4517-b881-a573445044f9 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:05.699658 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e55d8a1c-4f13-4a2c-a1d8-c4c53878bc97 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9" status: 404 len: 111 microversion: 2.1 time: 0.031791 Aug 24 09:08:05.699658 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 657/1265] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:05 2022] GET /compute/v2.1/servers/19c4f039-665a-4517-b881-a573445044f9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:08:05.752326 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9da16834-cdad-411d-9bfa-f641c1f0354e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:05.765145 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9da16834-cdad-411d-9bfa-f641c1f0354e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:05.767460 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-9da16834-cdad-411d-9bfa-f641c1f0354e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0d0eb9dc0f743c3985218901334b336', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeca01476604a70bed160e5aa97607c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:05.769559 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-9da16834-cdad-411d-9bfa-f641c1f0354e tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 200 len: 1654 microversion: 2.20 time: 0.126613 Aug 24 09:08:05.770838 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 609/1266] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:08:05 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 1654 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:08:05.790897 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-475f7ff6-5b01-46fc-9c20-ffd32acea1b8 req-321a68db-b65d-41d1-a89e-9663367156c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05dfbb2-5e47-4ddf-897d-10e19be499ca", "name": "network-vif-deleted", "tag": "ca6a6a1a-7c92-4d61-9b26-4ffea23e5485"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:08:05.809307 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-475f7ff6-5b01-46fc-9c20-ffd32acea1b8 req-321a68db-b65d-41d1-a89e-9663367156c8 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:05.809800 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-475f7ff6-5b01-46fc-9c20-ffd32acea1b8 req-321a68db-b65d-41d1-a89e-9663367156c8 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:05.810237 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-475f7ff6-5b01-46fc-9c20-ffd32acea1b8 req-321a68db-b65d-41d1-a89e-9663367156c8 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:05.832799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-475f7ff6-5b01-46fc-9c20-ffd32acea1b8 req-321a68db-b65d-41d1-a89e-9663367156c8 service nova] Creating event network-vif-deleted:ca6a6a1a-7c92-4d61-9b26-4ffea23e5485 for instance e05dfbb2-5e47-4ddf-897d-10e19be499ca on hv-cinder-83538 Aug 24 09:08:05.857744 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-475f7ff6-5b01-46fc-9c20-ffd32acea1b8 req-321a68db-b65d-41d1-a89e-9663367156c8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071724 Aug 24 09:08:05.859150 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 658/1267] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:08:06.796762 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-659eba7e-007e-4169-873b-991a1f112fa0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:06.797475 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-659eba7e-007e-4169-873b-991a1f112fa0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:06.804698 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-659eba7e-007e-4169-873b-991a1f112fa0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:06.805265 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-659eba7e-007e-4169-873b-991a1f112fa0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:06.805766 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-659eba7e-007e-4169-873b-991a1f112fa0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:06.806530 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-659eba7e-007e-4169-873b-991a1f112fa0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:06.807058 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-659eba7e-007e-4169-873b-991a1f112fa0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:06.807571 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-659eba7e-007e-4169-873b-991a1f112fa0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:06.821701 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-659eba7e-007e-4169-873b-991a1f112fa0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] HTTP exception thrown: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-659eba7e-007e-4169-873b-991a1f112fa0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Request method failure captured: Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca HTTP/1.1 Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeQU6uZPFeG01QEvK7InhHNu7ZJBw3451aN_mPEG1emv2IfRGP0oF-xEB7A2Lyum-HtdKYpfy_wQH-jlmjKOtCRTWyX4BbXtAJvqgolqYV7P1IlvpRWvCU2rjo8ZZZpmKlZ3g6ykazs52HXiYXii78tRBeD3USEcpPQlzlYckZAtUM Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: edeca01476604a70bed160e5aa97607c Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:08:06.823715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:08:06.826480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_edeca01476604a70bed160e5aa97607c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/edeca01476604a70bed160e5aa97607c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/edeca01476604a70bed160e5aa97607c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/edeca01476604a70bed160e5aa97607c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:08:06.826480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:08:06.826480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: edeca01476604a70bed160e5aa97607c Aug 24 09:08:06.826480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:08:06.826480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-AttachVolumeShelveTestJSON-1568880508-project Aug 24 09:08:06.826480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:08:06.826480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:08:06.826480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: f0d0eb9dc0f743c3985218901334b336 Aug 24 09:08:06.826480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1568880508-project Aug 24 09:08:06.826480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:08:06.826480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. Aug 24 09:08:06.826480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': 'e05dfbb2-5e47-4ddf-897d-10e19be499ca'} Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:06.827474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. Aug 24 09:08:06.828752 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:06.830510 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-659eba7e-007e-4169-873b-991a1f112fa0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Returning 404 to user: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:06.830510 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-659eba7e-007e-4169-873b-991a1f112fa0 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 404 len: 111 microversion: 2.20 time: 0.032335 Aug 24 09:08:06.830510 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 610/1268] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:08:06 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:08:06.837556 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6d7eed44-40c0-4f8f-a188-5d8579a502b9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '.version_select at 0x7fb14180d1f0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:06.861865 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6d7eed44-40c0-4f8f-a188-5d8579a502b9 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778024209" status: 204 len: 0 microversion: 2.20 time: 0.029441 Aug 24 09:08:06.862600 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 659/1269] 10.222.0.67 () {60 vars in 1262 bytes} [Wed Aug 24 09:08:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778024209 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 09:08:06.887969 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ff040d45-89a1-4b52-a684-ad385e927310 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:06.888606 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ff040d45-89a1-4b52-a684-ad385e927310 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:06.895561 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff040d45-89a1-4b52-a684-ad385e927310 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:06.896357 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff040d45-89a1-4b52-a684-ad385e927310 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:06.896951 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff040d45-89a1-4b52-a684-ad385e927310 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:06.897919 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff040d45-89a1-4b52-a684-ad385e927310 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:06.898287 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff040d45-89a1-4b52-a684-ad385e927310 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:06.898711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ff040d45-89a1-4b52-a684-ad385e927310 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:06.914803 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-ff040d45-89a1-4b52-a684-ad385e927310 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] HTTP exception thrown: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ff040d45-89a1-4b52-a684-ad385e927310 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Request method failure captured: Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e HTTP/1.1 Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeebN0Zobm2z9rP6Ekh4dDHbb3SuIkLHnpc3jkEcaHX4GwAfCoUa-aKWg_1MrmPsv97hdPp9j0fQ8hJI9Rp88PNgp2Z4khPlc0lMhYOfsdGUEPCdmARxQAqvXejsu5r4s5TUgAt8jNrxZH2x0zVTldxkuHkKggh8MFCnTglnQHmP2Dw Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:08:06.916466 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:08:06.917964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:08:06.917964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:06.917964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:06.917964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:06.917964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:06.917964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:08:06.917964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:08:06.917964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: bd0929f371e4442eb4eb6e12a96bbfc4 Aug 24 09:08:06.917964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:06.917964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:08:06.917964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. Aug 24 09:08:06.917964 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': '4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e'} Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:06.918868 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. Aug 24 09:08:06.920240 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:06.921759 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ff040d45-89a1-4b52-a684-ad385e927310 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Returning 404 to user: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:06.921759 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ff040d45-89a1-4b52-a684-ad385e927310 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 404 len: 111 microversion: 2.1 time: 0.033820 Aug 24 09:08:06.921759 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 611/1270] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:08:06 2022] DELETE /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 09:08:06.929376 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f82eda7d-5b71-4f3f-9b8f-730e1d65ea3a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:06.931151 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f82eda7d-5b71-4f3f-9b8f-730e1d65ea3a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:06.939002 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f82eda7d-5b71-4f3f-9b8f-730e1d65ea3a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:06.939497 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f82eda7d-5b71-4f3f-9b8f-730e1d65ea3a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:06.940020 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f82eda7d-5b71-4f3f-9b8f-730e1d65ea3a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:06.940753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f82eda7d-5b71-4f3f-9b8f-730e1d65ea3a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:06.941286 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f82eda7d-5b71-4f3f-9b8f-730e1d65ea3a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:06.941701 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f82eda7d-5b71-4f3f-9b8f-730e1d65ea3a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:06.955174 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-f82eda7d-5b71-4f3f-9b8f-730e1d65ea3a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] HTTP exception thrown: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f82eda7d-5b71-4f3f-9b8f-730e1d65ea3a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Request method failure captured: Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e HTTP/1.1 Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeebN0Zobm2z9rP6Ekh4dDHbb3SuIkLHnpc3jkEcaHX4GwAfCoUa-aKWg_1MrmPsv97hdPp9j0fQ8hJI9Rp88PNgp2Z4khPlc0lMhYOfsdGUEPCdmARxQAqvXejsu5r4s5TUgAt8jNrxZH2x0zVTldxkuHkKggh8MFCnTglnQHmP2Dw Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:08:06.957442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:08:06.959071 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:08:06.959071 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:06.959071 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:06.959071 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:06.959071 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:06.959071 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:08:06.959071 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:08:06.959071 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: bd0929f371e4442eb4eb6e12a96bbfc4 Aug 24 09:08:06.959071 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:06.959071 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:08:06.959071 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. Aug 24 09:08:06.959071 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e'} Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:06.959975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. Aug 24 09:08:06.961595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:06.963467 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f82eda7d-5b71-4f3f-9b8f-730e1d65ea3a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Returning 404 to user: Instance 4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:06.964351 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f82eda7d-5b71-4f3f-9b8f-730e1d65ea3a tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e" status: 404 len: 111 microversion: 2.1 time: 0.040245 Aug 24 09:08:06.965162 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 660/1271] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:06 2022] GET /compute/v2.1/servers/4ce2ec16-3df0-4ae9-8f7d-0348bca8ae4e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:08:06.974035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d2cb507c-e462-4e4c-9c87-4e298b4a10ba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:06.974463 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d2cb507c-e462-4e4c-9c87-4e298b4a10ba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:06.980469 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2cb507c-e462-4e4c-9c87-4e298b4a10ba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:06.980958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2cb507c-e462-4e4c-9c87-4e298b4a10ba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:06.981388 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2cb507c-e462-4e4c-9c87-4e298b4a10ba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:06.982106 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2cb507c-e462-4e4c-9c87-4e298b4a10ba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:06.982553 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2cb507c-e462-4e4c-9c87-4e298b4a10ba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:06.983228 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d2cb507c-e462-4e4c-9c87-4e298b4a10ba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:06.997097 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-d2cb507c-e462-4e4c-9c87-4e298b4a10ba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] HTTP exception thrown: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d2cb507c-e462-4e4c-9c87-4e298b4a10ba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Request method failure captured: Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 HTTP/1.1 Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeebN0Zobm2z9rP6Ekh4dDHbb3SuIkLHnpc3jkEcaHX4GwAfCoUa-aKWg_1MrmPsv97hdPp9j0fQ8hJI9Rp88PNgp2Z4khPlc0lMhYOfsdGUEPCdmARxQAqvXejsu5r4s5TUgAt8jNrxZH2x0zVTldxkuHkKggh8MFCnTglnQHmP2Dw Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:08:06.998641 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:08:07.000268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:08:07.000268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:07.000268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:07.000268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:07.000268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:07.000268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:08:07.000268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:08:07.000268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: bd0929f371e4442eb4eb6e12a96bbfc4 Aug 24 09:08:07.000268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:07.000268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:08:07.000268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. Aug 24 09:08:07.000268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': '08718641-a85b-4edf-9dc2-c8e30724b3b5'} Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:07.001179 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. Aug 24 09:08:07.002628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:07.004361 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d2cb507c-e462-4e4c-9c87-4e298b4a10ba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Returning 404 to user: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:07.004361 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d2cb507c-e462-4e4c-9c87-4e298b4a10ba tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "DELETE /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 404 len: 111 microversion: 2.1 time: 0.032653 Aug 24 09:08:07.006579 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 612/1272] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:08:06 2022] DELETE /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:08:07.013484 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-11207b27-a735-4b66-8db0-9187525c02b2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:07.014094 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-11207b27-a735-4b66-8db0-9187525c02b2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 08718641-a85b-4edf-9dc2-c8e30724b3b5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:07.022162 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11207b27-a735-4b66-8db0-9187525c02b2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:07.022651 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11207b27-a735-4b66-8db0-9187525c02b2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:07.023086 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11207b27-a735-4b66-8db0-9187525c02b2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:07.023787 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11207b27-a735-4b66-8db0-9187525c02b2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:07.024326 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11207b27-a735-4b66-8db0-9187525c02b2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:07.024749 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-11207b27-a735-4b66-8db0-9187525c02b2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:07.039395 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-11207b27-a735-4b66-8db0-9187525c02b2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] HTTP exception thrown: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-11207b27-a735-4b66-8db0-9187525c02b2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Request method failure captured: Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 HTTP/1.1 Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeebN0Zobm2z9rP6Ekh4dDHbb3SuIkLHnpc3jkEcaHX4GwAfCoUa-aKWg_1MrmPsv97hdPp9j0fQ8hJI9Rp88PNgp2Z4khPlc0lMhYOfsdGUEPCdmARxQAqvXejsu5r4s5TUgAt8jNrxZH2x0zVTldxkuHkKggh8MFCnTglnQHmP2Dw Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:08:07.041068 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:08:07.042675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:08:07.042675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:07.042675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:07.042675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:07.042675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:07.042675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:08:07.042675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:08:07.042675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: bd0929f371e4442eb4eb6e12a96bbfc4 Aug 24 09:08:07.042675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:07.042675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:08:07.042675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. Aug 24 09:08:07.042675 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '08718641-a85b-4edf-9dc2-c8e30724b3b5'} Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:07.043569 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. Aug 24 09:08:07.045943 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:07.049364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-11207b27-a735-4b66-8db0-9187525c02b2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Returning 404 to user: Instance 08718641-a85b-4edf-9dc2-c8e30724b3b5 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:07.049364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-11207b27-a735-4b66-8db0-9187525c02b2 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5" status: 404 len: 111 microversion: 2.1 time: 0.034280 Aug 24 09:08:07.049364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 661/1273] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:07 2022] GET /compute/v2.1/servers/08718641-a85b-4edf-9dc2-c8e30724b3b5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:08:08.192125 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ced263d9-7de6-424c-926b-25031a4a4419 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:08.192624 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ced263d9-7de6-424c-926b-25031a4a4419 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:08.199041 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ced263d9-7de6-424c-926b-25031a4a4419 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:08.199478 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ced263d9-7de6-424c-926b-25031a4a4419 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:08.199912 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ced263d9-7de6-424c-926b-25031a4a4419 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:08.200632 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ced263d9-7de6-424c-926b-25031a4a4419 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:08.201085 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ced263d9-7de6-424c-926b-25031a4a4419 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:08.201506 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ced263d9-7de6-424c-926b-25031a4a4419 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:08.217164 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-ced263d9-7de6-424c-926b-25031a4a4419 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] HTTP exception thrown: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ced263d9-7de6-424c-926b-25031a4a4419 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Request method failure captured: Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 HTTP/1.1 Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeebN0Zobm2z9rP6Ekh4dDHbb3SuIkLHnpc3jkEcaHX4GwAfCoUa-aKWg_1MrmPsv97hdPp9j0fQ8hJI9Rp88PNgp2Z4khPlc0lMhYOfsdGUEPCdmARxQAqvXejsu5r4s5TUgAt8jNrxZH2x0zVTldxkuHkKggh8MFCnTglnQHmP2Dw Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:08:08.218709 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:08:08.220409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:08:08.220409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:08.220409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:08.220409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:08.220409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:08.220409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:08:08.220409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:08:08.220409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: bd0929f371e4442eb4eb6e12a96bbfc4 Aug 24 09:08:08.220409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:08.220409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:08:08.220409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. Aug 24 09:08:08.220409 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': '4e52bd97-9ce6-4cc5-bd9a-3218b1a23645'} Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:08.221273 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. Aug 24 09:08:08.223482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.225025 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ced263d9-7de6-424c-926b-25031a4a4419 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Returning 404 to user: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:08.225025 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ced263d9-7de6-424c-926b-25031a4a4419 tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 404 len: 111 microversion: 2.1 time: 0.031952 Aug 24 09:08:08.225025 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 613/1274] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:08:08 2022] DELETE /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:08:08.229376 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9dc063c1-f571-423d-8460-adb92e3420df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:08.229993 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9dc063c1-f571-423d-8460-adb92e3420df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] [instance: 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:08.236694 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dc063c1-f571-423d-8460-adb92e3420df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:08.237179 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dc063c1-f571-423d-8460-adb92e3420df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:08.237621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dc063c1-f571-423d-8460-adb92e3420df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:08.238832 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dc063c1-f571-423d-8460-adb92e3420df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:08.239474 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dc063c1-f571-423d-8460-adb92e3420df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:08.239916 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9dc063c1-f571-423d-8460-adb92e3420df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:08.253014 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-9dc063c1-f571-423d-8460-adb92e3420df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] HTTP exception thrown: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9dc063c1-f571-423d-8460-adb92e3420df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Request method failure captured: Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 HTTP/1.1 Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeebN0Zobm2z9rP6Ekh4dDHbb3SuIkLHnpc3jkEcaHX4GwAfCoUa-aKWg_1MrmPsv97hdPp9j0fQ8hJI9Rp88PNgp2Z4khPlc0lMhYOfsdGUEPCdmARxQAqvXejsu5r4s5TUgAt8jNrxZH2x0zVTldxkuHkKggh8MFCnTglnQHmP2Dw Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:08:08.254610 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:08:08.256309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/7e6183eeb3ff43e79eccb5d7ad08c53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:08:08.256309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:08.256309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 7e6183eeb3ff43e79eccb5d7ad08c53c Aug 24 09:08:08.256309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-507334863 Aug 24 09:08:08.256309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:08.256309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:08:08.256309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:08:08.256309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: bd0929f371e4442eb4eb6e12a96bbfc4 Aug 24 09:08:08.256309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeNegativeTest-507334863-project Aug 24 09:08:08.256309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:08:08.256309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. Aug 24 09:08:08.256309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '4e52bd97-9ce6-4cc5-bd9a-3218b1a23645'} Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:08.257253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. Aug 24 09:08:08.259100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.260662 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9dc063c1-f571-423d-8460-adb92e3420df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] Returning 404 to user: Instance 4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:08.260662 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9dc063c1-f571-423d-8460-adb92e3420df tempest-AttachVolumeNegativeTest-507334863 tempest-AttachVolumeNegativeTest-507334863-project] 10.222.0.67 "GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645" status: 404 len: 111 microversion: 2.1 time: 0.030407 Aug 24 09:08:08.260662 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 662/1275] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:08 2022] GET /compute/v2.1/servers/4e52bd97-9ce6-4cc5-bd9a-3218b1a23645 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:08:08.672620 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c401105-7448-43c5-b29b-cf89efad85a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:08.673117 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1c401105-7448-43c5-b29b-cf89efad85a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:08.679156 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c401105-7448-43c5-b29b-cf89efad85a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:08.679646 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c401105-7448-43c5-b29b-cf89efad85a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:08.680082 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c401105-7448-43c5-b29b-cf89efad85a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:08.680814 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c401105-7448-43c5-b29b-cf89efad85a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:08.681249 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c401105-7448-43c5-b29b-cf89efad85a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:08.681675 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1c401105-7448-43c5-b29b-cf89efad85a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:08.695782 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-1c401105-7448-43c5-b29b-cf89efad85a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] HTTP exception thrown: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c401105-7448-43c5-b29b-cf89efad85a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Request method failure captured: Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca HTTP/1.1 Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeQU6uZPFeG01QEvK7InhHNu7ZJBw3451aN_mPEG1emv2IfRGP0oF-xEB7A2Lyum-HtdKYpfy_wQH-jlmjKOtCRTWyX4BbXtAJvqgolqYV7P1IlvpRWvCU2rjo8ZZZpmKlZ3g6ykazs52HXiYXii78tRBeD3USEcpPQlzlYckZAtUM Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: edeca01476604a70bed160e5aa97607c Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:08:08.697536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:08:08.699142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_edeca01476604a70bed160e5aa97607c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/edeca01476604a70bed160e5aa97607c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/edeca01476604a70bed160e5aa97607c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/edeca01476604a70bed160e5aa97607c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:08:08.699142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:08:08.699142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: edeca01476604a70bed160e5aa97607c Aug 24 09:08:08.699142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:08:08.699142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-AttachVolumeShelveTestJSON-1568880508-project Aug 24 09:08:08.699142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:08:08.699142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:08:08.699142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: f0d0eb9dc0f743c3985218901334b336 Aug 24 09:08:08.699142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1568880508-project Aug 24 09:08:08.699142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:08:08.699142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. Aug 24 09:08:08.699142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': 'e05dfbb2-5e47-4ddf-897d-10e19be499ca'} Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:08.700000 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. Aug 24 09:08:08.701436 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.703262 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1c401105-7448-43c5-b29b-cf89efad85a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Returning 404 to user: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:08.703262 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1c401105-7448-43c5-b29b-cf89efad85a5 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 404 len: 111 microversion: 2.20 time: 0.030172 Aug 24 09:08:08.703262 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 614/1276] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 24 09:08:08 2022] DELETE /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:08:08.708980 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c850e2c5-9486-4c5b-86f7-3d2b9bc0a280 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:08.709739 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c850e2c5-9486-4c5b-86f7-3d2b9bc0a280 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: e05dfbb2-5e47-4ddf-897d-10e19be499ca] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:08.720807 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c850e2c5-9486-4c5b-86f7-3d2b9bc0a280 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:08.721407 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c850e2c5-9486-4c5b-86f7-3d2b9bc0a280 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:08.721922 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c850e2c5-9486-4c5b-86f7-3d2b9bc0a280 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:08.722955 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c850e2c5-9486-4c5b-86f7-3d2b9bc0a280 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:08.723509 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c850e2c5-9486-4c5b-86f7-3d2b9bc0a280 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:08.724016 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c850e2c5-9486-4c5b-86f7-3d2b9bc0a280 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:08.742215 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-c850e2c5-9486-4c5b-86f7-3d2b9bc0a280 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] HTTP exception thrown: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c850e2c5-9486-4c5b-86f7-3d2b9bc0a280 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Request method failure captured: Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca HTTP/1.1 Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeeQU6uZPFeG01QEvK7InhHNu7ZJBw3451aN_mPEG1emv2IfRGP0oF-xEB7A2Lyum-HtdKYpfy_wQH-jlmjKOtCRTWyX4BbXtAJvqgolqYV7P1IlvpRWvCU2rjo8ZZZpmKlZ3g6ykazs52HXiYXii78tRBeD3USEcpPQlzlYckZAtUM Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: edeca01476604a70bed160e5aa97607c Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:08:08.744000 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:08:08.745679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_edeca01476604a70bed160e5aa97607c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/edeca01476604a70bed160e5aa97607c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/edeca01476604a70bed160e5aa97607c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/edeca01476604a70bed160e5aa97607c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:08:08.745679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:08:08.745679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: edeca01476604a70bed160e5aa97607c Aug 24 09:08:08.745679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:08:08.745679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-AttachVolumeShelveTestJSON-1568880508-project Aug 24 09:08:08.745679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:08:08.745679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:08:08.745679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: f0d0eb9dc0f743c3985218901334b336 Aug 24 09:08:08.745679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1568880508-project Aug 24 09:08:08.745679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:08:08.745679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. Aug 24 09:08:08.745679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': 'e05dfbb2-5e47-4ddf-897d-10e19be499ca'} Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:08.746621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. Aug 24 09:08:08.747990 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:08.749206 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c850e2c5-9486-4c5b-86f7-3d2b9bc0a280 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Returning 404 to user: Instance e05dfbb2-5e47-4ddf-897d-10e19be499ca could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:08.749206 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c850e2c5-9486-4c5b-86f7-3d2b9bc0a280 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca" status: 404 len: 111 microversion: 2.20 time: 0.041353 Aug 24 09:08:08.749206 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 663/1277] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:08:08 2022] GET /compute/v2.1/servers/e05dfbb2-5e47-4ddf-897d-10e19be499ca => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:08:09.892974 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dbfd048e-fef8-4e68-9489-76caea6c63d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:09.894309 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dbfd048e-fef8-4e68-9489-76caea6c63d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:09.901137 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbfd048e-fef8-4e68-9489-76caea6c63d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:09.901704 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbfd048e-fef8-4e68-9489-76caea6c63d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:09.902221 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbfd048e-fef8-4e68-9489-76caea6c63d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:09.903001 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbfd048e-fef8-4e68-9489-76caea6c63d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:09.903536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbfd048e-fef8-4e68-9489-76caea6c63d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:09.904181 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dbfd048e-fef8-4e68-9489-76caea6c63d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:09.918839 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-dbfd048e-fef8-4e68-9489-76caea6c63d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] HTTP exception thrown: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dbfd048e-fef8-4e68-9489-76caea6c63d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Request method failure captured: Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 HTTP/1.1 Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeeQU6uZPFeG01QEvK7InhHNu7ZJBw3451aN_mPEG1emv2IfRGP0oF-xEB7A2Lyum-HtdKYpfy_wQH-jlmjKOtCRTWyX4BbXtAJvqgolqYV7P1IlvpRWvCU2rjo8ZZZpmKlZ3g6ykazs52HXiYXii78tRBeD3USEcpPQlzlYckZAtUM Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: edeca01476604a70bed160e5aa97607c Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:08:09.920587 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:08:09.922042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_edeca01476604a70bed160e5aa97607c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/edeca01476604a70bed160e5aa97607c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/edeca01476604a70bed160e5aa97607c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/edeca01476604a70bed160e5aa97607c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:08:09.922042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:08:09.922042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: edeca01476604a70bed160e5aa97607c Aug 24 09:08:09.922042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:08:09.922042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-AttachVolumeShelveTestJSON-1568880508-project Aug 24 09:08:09.922042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:08:09.922042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:08:09.922042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: f0d0eb9dc0f743c3985218901334b336 Aug 24 09:08:09.922042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1568880508-project Aug 24 09:08:09.922042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:08:09.922042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. Aug 24 09:08:09.922042 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': '4866e8f4-ddfe-4cee-8bcc-5db7372926f5'} Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:09.923884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. Aug 24 09:08:09.926076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:08:09.927592 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dbfd048e-fef8-4e68-9489-76caea6c63d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Returning 404 to user: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:09.927592 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dbfd048e-fef8-4e68-9489-76caea6c63d7 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 404 len: 111 microversion: 2.20 time: 0.033113 Aug 24 09:08:09.927592 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 615/1278] 10.222.0.67 () {60 vars in 1280 bytes} [Wed Aug 24 09:08:09 2022] DELETE /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:08:09.934914 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-31b7f6be-36e4-4709-86b2-7a0765808629 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:09.935535 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-31b7f6be-36e4-4709-86b2-7a0765808629 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] [instance: 4866e8f4-ddfe-4cee-8bcc-5db7372926f5] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:09.943002 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31b7f6be-36e4-4709-86b2-7a0765808629 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:09.943491 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31b7f6be-36e4-4709-86b2-7a0765808629 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:09.944124 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31b7f6be-36e4-4709-86b2-7a0765808629 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:09.944857 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31b7f6be-36e4-4709-86b2-7a0765808629 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:09.945309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31b7f6be-36e4-4709-86b2-7a0765808629 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:09.945731 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-31b7f6be-36e4-4709-86b2-7a0765808629 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:09.960777 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-31b7f6be-36e4-4709-86b2-7a0765808629 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] HTTP exception thrown: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-31b7f6be-36e4-4709-86b2-7a0765808629 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Request method failure captured: Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 HTTP/1.1 Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBeeQU6uZPFeG01QEvK7InhHNu7ZJBw3451aN_mPEG1emv2IfRGP0oF-xEB7A2Lyum-HtdKYpfy_wQH-jlmjKOtCRTWyX4BbXtAJvqgolqYV7P1IlvpRWvCU2rjo8ZZZpmKlZ3g6ykazs52HXiYXii78tRBeD3USEcpPQlzlYckZAtUM Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: edeca01476604a70bed160e5aa97607c Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:08:09.962562 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:08:09.964316 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_edeca01476604a70bed160e5aa97607c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/edeca01476604a70bed160e5aa97607c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/edeca01476604a70bed160e5aa97607c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/edeca01476604a70bed160e5aa97607c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:08:09.964316 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:08:09.964316 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: edeca01476604a70bed160e5aa97607c Aug 24 09:08:09.964316 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1568880508 Aug 24 09:08:09.964316 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-AttachVolumeShelveTestJSON-1568880508-project Aug 24 09:08:09.964316 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:08:09.964316 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:08:09.964316 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: f0d0eb9dc0f743c3985218901334b336 Aug 24 09:08:09.964316 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1568880508-project Aug 24 09:08:09.964316 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:08:09.964316 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. Aug 24 09:08:09.964316 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '4866e8f4-ddfe-4cee-8bcc-5db7372926f5'} Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:08:09.965201 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. Aug 24 09:08:09.966773 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:08:09.968967 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-31b7f6be-36e4-4709-86b2-7a0765808629 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] Returning 404 to user: Instance 4866e8f4-ddfe-4cee-8bcc-5db7372926f5 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:08:09.969820 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-31b7f6be-36e4-4709-86b2-7a0765808629 tempest-AttachVolumeShelveTestJSON-1568880508 tempest-AttachVolumeShelveTestJSON-1568880508-project] 10.222.0.67 "GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5" status: 404 len: 111 microversion: 2.20 time: 0.040817 Aug 24 09:08:09.970373 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 664/1279] 10.222.0.67 () {60 vars in 1277 bytes} [Wed Aug 24 09:08:09 2022] GET /compute/v2.1/servers/4866e8f4-ddfe-4cee-8bcc-5db7372926f5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:08:46.548439 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-03959dfc-c19b-4c4d-9f9e-64a231b55d77 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Action: 'create', calling method: .version_select at 0x7fb140f87430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1889961013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFL4sHPC0oJi68GpLRDYpoCKUFJrlrgIxwEyFr1yImNZQ2Eo8FNI4NFkvK2I+eqJPi0ws9LJcSoHcnnJzYSjj9mGKjJTFI6Ku2EOwDUk6ftG6Ge1k8yIqtMkmwUkAgR+A=="}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:08:46.554347 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:08:46.554985 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:08:46.569337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-03959dfc-c19b-4c4d-9f9e-64a231b55d77 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Getting quotas for project 759df091a0664e68b9f38eec1f9c2e49. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:08:46.573510 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.quota [None req-03959dfc-c19b-4c4d-9f9e-64a231b55d77 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Getting quotas for user 517a70383bcd42eba23483981dd40d89 and project 759df091a0664e68b9f38eec1f9c2e49. Resources: {'key_pairs'} {{(pid=120543) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:08:46.598109 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-03959dfc-c19b-4c4d-9f9e-64a231b55d77 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053594 Aug 24 09:08:46.598704 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 616/1280] 10.222.0.67 () {60 vars in 1159 bytes} [Wed Aug 24 09:08:46 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:08:46.700192 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-522693219", "imageRef": "e0190db9-ee94-428f-bd86-ccf87a047745", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1889961013", "networks": [{"uuid": "30cf2066-c7de-477b-9ca6-2e6e7290f871"}]}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:08:46.708506 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:08:46.709152 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:08:46.769553 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.network.neutron [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] validate_networks() for [('30cf2066-c7de-477b-9ca6-2e6e7290f871', None, None, None, None, None)] {{(pid=120542) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:08:47.454266 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Flavor limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:08:47.454693 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Image limits 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:08:47.455174 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Flavor pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:08:47.455596 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Image pref 0:0:0 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:08:47.456015 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.virt.hardware [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120542) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:08:47.465768 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:47.466263 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:47.466699 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:47.467431 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:47.467888 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:47.468345 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:47.486230 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Getting quotas for project 759df091a0664e68b9f38eec1f9c2e49. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:08:47.490097 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.quota [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Getting quotas for user 517a70383bcd42eba23483981dd40d89 and project 759df091a0664e68b9f38eec1f9c2e49. Resources: {'cores', 'ram', 'instances'} {{(pid=120542) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:08:47.500907 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Going to run 1 instances... {{(pid=120542) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:08:47.503137 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e0190db9-ee94-428f-bd86-ccf87a047745',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120542) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:08:47.549020 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3e6c124b-e8af-4169-a4e3-813b2c192414 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853237 Aug 24 09:08:47.550169 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 665/1281] 10.222.0.67 () {60 vars in 1147 bytes} [Wed Aug 24 09:08:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:08:47.561880 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-18950a18-788c-48d8-b401-1251dc030cc3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:47.562493 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-18950a18-788c-48d8-b401-1251dc030cc3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:47.622528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-18950a18-788c-48d8-b401-1251dc030cc3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:47.630220 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-18950a18-788c-48d8-b401-1251dc030cc3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1258 microversion: 2.1 time: 0.073493 Aug 24 09:08:47.630768 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 617/1282] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:47 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:48.652180 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-47ab720f-a3df-4b5a-ae19-606af9aea82d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:48.652798 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-47ab720f-a3df-4b5a-ae19-606af9aea82d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:48.659218 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47ab720f-a3df-4b5a-ae19-606af9aea82d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:48.659705 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47ab720f-a3df-4b5a-ae19-606af9aea82d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:48.660236 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47ab720f-a3df-4b5a-ae19-606af9aea82d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:48.660935 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47ab720f-a3df-4b5a-ae19-606af9aea82d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:48.661398 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47ab720f-a3df-4b5a-ae19-606af9aea82d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:48.661826 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-47ab720f-a3df-4b5a-ae19-606af9aea82d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:48.730022 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-47ab720f-a3df-4b5a-ae19-606af9aea82d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:48.737777 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-47ab720f-a3df-4b5a-ae19-606af9aea82d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1262 microversion: 2.1 time: 0.090929 Aug 24 09:08:48.738330 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 666/1283] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:48 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:49.758527 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5ccf42bc-468e-4d55-88b3-ec90931a6e80 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:49.759232 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5ccf42bc-468e-4d55-88b3-ec90931a6e80 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:49.766437 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ccf42bc-468e-4d55-88b3-ec90931a6e80 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:49.766916 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ccf42bc-468e-4d55-88b3-ec90931a6e80 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:49.767346 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ccf42bc-468e-4d55-88b3-ec90931a6e80 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:49.768028 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ccf42bc-468e-4d55-88b3-ec90931a6e80 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:49.768508 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ccf42bc-468e-4d55-88b3-ec90931a6e80 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:49.768932 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5ccf42bc-468e-4d55-88b3-ec90931a6e80 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:49.829024 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5ccf42bc-468e-4d55-88b3-ec90931a6e80 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:49.836585 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5ccf42bc-468e-4d55-88b3-ec90931a6e80 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1262 microversion: 2.1 time: 0.082034 Aug 24 09:08:49.837131 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 618/1284] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:49 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:50.857682 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6ae45fa5-ea1f-4252-8f29-680e08f35b22 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:50.858236 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6ae45fa5-ea1f-4252-8f29-680e08f35b22 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:50.864804 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae45fa5-ea1f-4252-8f29-680e08f35b22 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:50.865283 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae45fa5-ea1f-4252-8f29-680e08f35b22 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:50.865713 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae45fa5-ea1f-4252-8f29-680e08f35b22 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:50.866398 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae45fa5-ea1f-4252-8f29-680e08f35b22 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:50.866848 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae45fa5-ea1f-4252-8f29-680e08f35b22 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:50.867267 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6ae45fa5-ea1f-4252-8f29-680e08f35b22 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:50.929255 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-6ae45fa5-ea1f-4252-8f29-680e08f35b22 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:50.937689 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6ae45fa5-ea1f-4252-8f29-680e08f35b22 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1254 microversion: 2.1 time: 0.084208 Aug 24 09:08:50.938253 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 667/1285] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:50 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1254 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:51.958445 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1e4ecd38-c4dc-48f3-ac31-1d4db362dfd3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:51.959155 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1e4ecd38-c4dc-48f3-ac31-1d4db362dfd3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:51.966343 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e4ecd38-c4dc-48f3-ac31-1d4db362dfd3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:51.967103 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e4ecd38-c4dc-48f3-ac31-1d4db362dfd3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:51.967753 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e4ecd38-c4dc-48f3-ac31-1d4db362dfd3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:51.968729 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e4ecd38-c4dc-48f3-ac31-1d4db362dfd3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:51.969574 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e4ecd38-c4dc-48f3-ac31-1d4db362dfd3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:51.970010 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1e4ecd38-c4dc-48f3-ac31-1d4db362dfd3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:52.047497 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1e4ecd38-c4dc-48f3-ac31-1d4db362dfd3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:52.062780 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1e4ecd38-c4dc-48f3-ac31-1d4db362dfd3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1316 microversion: 2.1 time: 0.107887 Aug 24 09:08:52.063303 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 619/1286] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:51 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1316 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:53.085095 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-84a1f2f8-d7d3-4d21-a21a-afa4ebb6821a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:53.085825 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-84a1f2f8-d7d3-4d21-a21a-afa4ebb6821a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:53.109348 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84a1f2f8-d7d3-4d21-a21a-afa4ebb6821a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:53.109348 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84a1f2f8-d7d3-4d21-a21a-afa4ebb6821a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:53.111872 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84a1f2f8-d7d3-4d21-a21a-afa4ebb6821a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:53.111872 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84a1f2f8-d7d3-4d21-a21a-afa4ebb6821a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:53.111872 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84a1f2f8-d7d3-4d21-a21a-afa4ebb6821a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:53.112248 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-84a1f2f8-d7d3-4d21-a21a-afa4ebb6821a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:53.428511 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-84a1f2f8-d7d3-4d21-a21a-afa4ebb6821a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:53.439012 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-84a1f2f8-d7d3-4d21-a21a-afa4ebb6821a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.357757 Aug 24 09:08:53.440066 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 668/1287] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:53 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:54.466307 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-32d50a80-9206-4416-949d-5e00d718442c tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:54.468060 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-32d50a80-9206-4416-949d-5e00d718442c tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:54.480865 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32d50a80-9206-4416-949d-5e00d718442c tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:54.481697 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32d50a80-9206-4416-949d-5e00d718442c tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:54.482353 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32d50a80-9206-4416-949d-5e00d718442c tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:54.483266 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32d50a80-9206-4416-949d-5e00d718442c tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:54.483926 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32d50a80-9206-4416-949d-5e00d718442c tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:54.484598 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-32d50a80-9206-4416-949d-5e00d718442c tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:54.653578 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-32d50a80-9206-4416-949d-5e00d718442c tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:54.670814 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-32d50a80-9206-4416-949d-5e00d718442c tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.209424 Aug 24 09:08:54.680581 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 620/1288] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:54 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:55.694974 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d9d1b5ed-e4fc-445f-bf91-601743462c56 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:55.704123 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d9d1b5ed-e4fc-445f-bf91-601743462c56 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:55.713777 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9d1b5ed-e4fc-445f-bf91-601743462c56 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:55.714285 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9d1b5ed-e4fc-445f-bf91-601743462c56 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:55.714783 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9d1b5ed-e4fc-445f-bf91-601743462c56 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:55.715864 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9d1b5ed-e4fc-445f-bf91-601743462c56 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:55.716570 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9d1b5ed-e4fc-445f-bf91-601743462c56 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:55.717171 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d9d1b5ed-e4fc-445f-bf91-601743462c56 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:55.905665 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-d9d1b5ed-e4fc-445f-bf91-601743462c56 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:55.916139 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d9d1b5ed-e4fc-445f-bf91-601743462c56 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.225821 Aug 24 09:08:55.917536 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 669/1289] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:55 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:56.939253 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-617b49ee-f8df-4106-bc6b-943b54d11390 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:56.939852 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-617b49ee-f8df-4106-bc6b-943b54d11390 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:56.947166 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-617b49ee-f8df-4106-bc6b-943b54d11390 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:56.947860 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-617b49ee-f8df-4106-bc6b-943b54d11390 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:56.948411 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-617b49ee-f8df-4106-bc6b-943b54d11390 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:56.949450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-617b49ee-f8df-4106-bc6b-943b54d11390 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:56.950058 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-617b49ee-f8df-4106-bc6b-943b54d11390 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:56.950690 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-617b49ee-f8df-4106-bc6b-943b54d11390 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:57.154043 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-617b49ee-f8df-4106-bc6b-943b54d11390 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:57.162450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-617b49ee-f8df-4106-bc6b-943b54d11390 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.227285 Aug 24 09:08:57.176473 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 621/1290] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:56 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:58.182994 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-14177c6b-7c4d-4fe2-9326-31910bddfea9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:58.183761 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-14177c6b-7c4d-4fe2-9326-31910bddfea9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:58.193863 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:08:58.197050 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=6 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:08:58.199243 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14177c6b-7c4d-4fe2-9326-31910bddfea9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:58.199875 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14177c6b-7c4d-4fe2-9326-31910bddfea9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:58.201753 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14177c6b-7c4d-4fe2-9326-31910bddfea9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:58.206947 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14177c6b-7c4d-4fe2-9326-31910bddfea9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:58.207668 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14177c6b-7c4d-4fe2-9326-31910bddfea9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:58.208276 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-14177c6b-7c4d-4fe2-9326-31910bddfea9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:58.448185 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-14177c6b-7c4d-4fe2-9326-31910bddfea9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:58.457862 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-14177c6b-7c4d-4fe2-9326-31910bddfea9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.278640 Aug 24 09:08:58.458443 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 670/1291] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:58 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:08:59.484032 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-018e0cfb-6fcd-463f-868c-269859047403 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:08:59.485773 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-018e0cfb-6fcd-463f-868c-269859047403 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:08:59.487889 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell0:SELECT=6 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:08:59.495857 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-018e0cfb-6fcd-463f-868c-269859047403 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:59.496360 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-018e0cfb-6fcd-463f-868c-269859047403 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:59.496996 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-018e0cfb-6fcd-463f-868c-269859047403 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:59.497885 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-018e0cfb-6fcd-463f-868c-269859047403 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:08:59.498660 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-018e0cfb-6fcd-463f-868c-269859047403 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:08:59.499259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-018e0cfb-6fcd-463f-868c-269859047403 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:08:59.698317 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-018e0cfb-6fcd-463f-868c-269859047403 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:08:59.708831 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-018e0cfb-6fcd-463f-868c-269859047403 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.230518 Aug 24 09:08:59.710979 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 622/1292] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:08:59 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:00.731660 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3b047efd-7979-4b20-bfae-134a598adc24 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:00.732280 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3b047efd-7979-4b20-bfae-134a598adc24 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:00.738708 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b047efd-7979-4b20-bfae-134a598adc24 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:00.739196 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b047efd-7979-4b20-bfae-134a598adc24 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:00.739643 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b047efd-7979-4b20-bfae-134a598adc24 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:00.740367 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b047efd-7979-4b20-bfae-134a598adc24 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:00.740830 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b047efd-7979-4b20-bfae-134a598adc24 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:00.741259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3b047efd-7979-4b20-bfae-134a598adc24 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:00.879166 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3b047efd-7979-4b20-bfae-134a598adc24 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:00.887108 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3b047efd-7979-4b20-bfae-134a598adc24 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.159466 Aug 24 09:09:00.887682 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 671/1293] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:00 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:01.907260 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-ad18740d-a59d-4cdd-afde-abc2400c655b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:01.907878 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-ad18740d-a59d-4cdd-afde-abc2400c655b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:01.915397 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad18740d-a59d-4cdd-afde-abc2400c655b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:01.915892 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad18740d-a59d-4cdd-afde-abc2400c655b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:01.916377 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad18740d-a59d-4cdd-afde-abc2400c655b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:01.917066 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad18740d-a59d-4cdd-afde-abc2400c655b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:01.917528 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad18740d-a59d-4cdd-afde-abc2400c655b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:01.917989 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-ad18740d-a59d-4cdd-afde-abc2400c655b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:02.046589 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-ad18740d-a59d-4cdd-afde-abc2400c655b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:02.054809 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-ad18740d-a59d-4cdd-afde-abc2400c655b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.150837 Aug 24 09:09:02.055369 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 623/1294] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:01 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:03.075819 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-79dbe79e-6e53-4e66-bef9-dd0fdc7cf949 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:03.076505 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-79dbe79e-6e53-4e66-bef9-dd0fdc7cf949 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:03.082996 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dbe79e-6e53-4e66-bef9-dd0fdc7cf949 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:03.083475 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dbe79e-6e53-4e66-bef9-dd0fdc7cf949 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:03.083911 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dbe79e-6e53-4e66-bef9-dd0fdc7cf949 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:03.084634 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dbe79e-6e53-4e66-bef9-dd0fdc7cf949 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:03.085715 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dbe79e-6e53-4e66-bef9-dd0fdc7cf949 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:03.086200 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-79dbe79e-6e53-4e66-bef9-dd0fdc7cf949 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:03.217063 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-79dbe79e-6e53-4e66-bef9-dd0fdc7cf949 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:03.224974 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-79dbe79e-6e53-4e66-bef9-dd0fdc7cf949 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.153071 Aug 24 09:09:03.225547 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 672/1295] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:03 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:04.244671 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-dba00197-f39c-42fc-b766-4879f014478f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:04.245313 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-dba00197-f39c-42fc-b766-4879f014478f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:04.251707 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dba00197-f39c-42fc-b766-4879f014478f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:04.252222 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dba00197-f39c-42fc-b766-4879f014478f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:04.252654 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dba00197-f39c-42fc-b766-4879f014478f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:04.253362 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dba00197-f39c-42fc-b766-4879f014478f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:04.253833 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dba00197-f39c-42fc-b766-4879f014478f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:04.254250 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-dba00197-f39c-42fc-b766-4879f014478f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:04.384192 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-dba00197-f39c-42fc-b766-4879f014478f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:04.391689 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-dba00197-f39c-42fc-b766-4879f014478f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.151066 Aug 24 09:09:04.392271 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 624/1296] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:04 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:05.413614 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3208cc22-5177-4b38-9f5b-4f5e17c6acab tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:05.414364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3208cc22-5177-4b38-9f5b-4f5e17c6acab tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:05.420931 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3208cc22-5177-4b38-9f5b-4f5e17c6acab tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:05.421417 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3208cc22-5177-4b38-9f5b-4f5e17c6acab tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:05.421852 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3208cc22-5177-4b38-9f5b-4f5e17c6acab tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:05.422551 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3208cc22-5177-4b38-9f5b-4f5e17c6acab tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:05.423005 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3208cc22-5177-4b38-9f5b-4f5e17c6acab tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:05.423429 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3208cc22-5177-4b38-9f5b-4f5e17c6acab tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:05.577872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3ef17b44-9fbc-4bc3-988e-1e11ff116f41 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:05.578388 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3ef17b44-9fbc-4bc3-988e-1e11ff116f41 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:05.586058 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ef17b44-9fbc-4bc3-988e-1e11ff116f41 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:05.586640 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ef17b44-9fbc-4bc3-988e-1e11ff116f41 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:05.587159 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ef17b44-9fbc-4bc3-988e-1e11ff116f41 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:05.587938 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ef17b44-9fbc-4bc3-988e-1e11ff116f41 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:05.588495 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ef17b44-9fbc-4bc3-988e-1e11ff116f41 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:05.588991 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3ef17b44-9fbc-4bc3-988e-1e11ff116f41 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:05.603314 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3208cc22-5177-4b38-9f5b-4f5e17c6acab tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:05.613051 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3208cc22-5177-4b38-9f5b-4f5e17c6acab tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.203941 Aug 24 09:09:05.613886 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 673/1297] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:05 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:05.619017 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3ef17b44-9fbc-4bc3-988e-1e11ff116f41 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Going to try to terminate instance {{(pid=120543) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:09:05.634183 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-7f70c2be-c0a7-4b78-a13b-b8f5eab36782 req-de9a4f5f-06db-4a64-b2e3-323646b9b4ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "305f45c9-6610-45f1-ba0b-96088c32bdbd", "tag": "3e1c506d-5244-4f4d-87cb-d02d5c2acbde"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:09:05.644459 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7f70c2be-c0a7-4b78-a13b-b8f5eab36782 req-de9a4f5f-06db-4a64-b2e3-323646b9b4ca service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:05.645099 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7f70c2be-c0a7-4b78-a13b-b8f5eab36782 req-de9a4f5f-06db-4a64-b2e3-323646b9b4ca service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:05.645521 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-7f70c2be-c0a7-4b78-a13b-b8f5eab36782 req-de9a4f5f-06db-4a64-b2e3-323646b9b4ca service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:05.658061 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-7f70c2be-c0a7-4b78-a13b-b8f5eab36782 req-de9a4f5f-06db-4a64-b2e3-323646b9b4ca service nova] Creating event network-changed:3e1c506d-5244-4f4d-87cb-d02d5c2acbde for instance 305f45c9-6610-45f1-ba0b-96088c32bdbd on hv-cinder-83538 Aug 24 09:09:05.663969 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-7f70c2be-c0a7-4b78-a13b-b8f5eab36782 req-de9a4f5f-06db-4a64-b2e3-323646b9b4ca service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034703 Aug 24 09:09:05.664617 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 674/1298] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:09:05.708863 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3ef17b44-9fbc-4bc3-988e-1e11ff116f41 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "DELETE /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 204 len: 0 microversion: 2.1 time: 0.135467 Aug 24 09:09:05.710058 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 625/1299] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:09:05 2022] DELETE /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:09:05.719273 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4d768877-6286-4945-ae50-88eab357bbe8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:05.719975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4d768877-6286-4945-ae50-88eab357bbe8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:05.727113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d768877-6286-4945-ae50-88eab357bbe8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:05.727602 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d768877-6286-4945-ae50-88eab357bbe8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:05.728035 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d768877-6286-4945-ae50-88eab357bbe8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:05.728755 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d768877-6286-4945-ae50-88eab357bbe8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:05.729207 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d768877-6286-4945-ae50-88eab357bbe8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:05.729628 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4d768877-6286-4945-ae50-88eab357bbe8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:05.868718 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-4d768877-6286-4945-ae50-88eab357bbe8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:05.876669 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4d768877-6286-4945-ae50-88eab357bbe8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1578 microversion: 2.1 time: 0.161834 Aug 24 09:09:05.877239 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 675/1300] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:05 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:06.635439 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-832084d2-38d3-4a4f-824a-edbd33b85ad3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:06.636167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-832084d2-38d3-4a4f-824a-edbd33b85ad3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:06.642525 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-832084d2-38d3-4a4f-824a-edbd33b85ad3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:06.643006 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-832084d2-38d3-4a4f-824a-edbd33b85ad3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:06.643443 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-832084d2-38d3-4a4f-824a-edbd33b85ad3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:06.644155 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-832084d2-38d3-4a4f-824a-edbd33b85ad3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:06.644614 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-832084d2-38d3-4a4f-824a-edbd33b85ad3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:06.645066 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-832084d2-38d3-4a4f-824a-edbd33b85ad3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:06.776995 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-832084d2-38d3-4a4f-824a-edbd33b85ad3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:06.784628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-832084d2-38d3-4a4f-824a-edbd33b85ad3 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.153517 Aug 24 09:09:06.785191 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 626/1301] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:06 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:06.899594 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-85ddc4a1-dc48-4956-80ea-bcdf63fdec39 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:06.900256 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-85ddc4a1-dc48-4956-80ea-bcdf63fdec39 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:06.906612 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85ddc4a1-dc48-4956-80ea-bcdf63fdec39 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:06.907087 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85ddc4a1-dc48-4956-80ea-bcdf63fdec39 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:06.907524 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85ddc4a1-dc48-4956-80ea-bcdf63fdec39 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:06.908234 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85ddc4a1-dc48-4956-80ea-bcdf63fdec39 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:06.908682 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85ddc4a1-dc48-4956-80ea-bcdf63fdec39 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:06.909100 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-85ddc4a1-dc48-4956-80ea-bcdf63fdec39 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:07.043457 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-85ddc4a1-dc48-4956-80ea-bcdf63fdec39 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:07.051208 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-85ddc4a1-dc48-4956-80ea-bcdf63fdec39 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1578 microversion: 2.1 time: 0.155570 Aug 24 09:09:07.051766 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 676/1302] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:06 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:07.807212 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-012bd022-1401-4429-be94-b192990bb28e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:07.807829 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-012bd022-1401-4429-be94-b192990bb28e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:07.814420 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-012bd022-1401-4429-be94-b192990bb28e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:07.814851 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-012bd022-1401-4429-be94-b192990bb28e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:07.815294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-012bd022-1401-4429-be94-b192990bb28e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:07.815987 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-012bd022-1401-4429-be94-b192990bb28e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:07.816473 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-012bd022-1401-4429-be94-b192990bb28e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:07.816903 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-012bd022-1401-4429-be94-b192990bb28e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:07.948295 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-012bd022-1401-4429-be94-b192990bb28e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:07.955958 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-012bd022-1401-4429-be94-b192990bb28e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.153287 Aug 24 09:09:07.956544 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 627/1303] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:07 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:08.073879 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-27a9d886-5293-4006-95b0-63cf23c4adfc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:08.074434 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-27a9d886-5293-4006-95b0-63cf23c4adfc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:08.080799 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27a9d886-5293-4006-95b0-63cf23c4adfc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:08.081289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27a9d886-5293-4006-95b0-63cf23c4adfc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:08.081732 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27a9d886-5293-4006-95b0-63cf23c4adfc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:08.082427 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27a9d886-5293-4006-95b0-63cf23c4adfc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:08.082894 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27a9d886-5293-4006-95b0-63cf23c4adfc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:08.083324 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-27a9d886-5293-4006-95b0-63cf23c4adfc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:08.213065 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-27a9d886-5293-4006-95b0-63cf23c4adfc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:08.221010 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-27a9d886-5293-4006-95b0-63cf23c4adfc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1578 microversion: 2.1 time: 0.151265 Aug 24 09:09:08.221844 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 677/1304] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:08 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:08.977066 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-cd99dce2-7b80-432f-8464-4932feea5c0f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:08.977687 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-cd99dce2-7b80-432f-8464-4932feea5c0f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:08.984156 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd99dce2-7b80-432f-8464-4932feea5c0f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:08.984646 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd99dce2-7b80-432f-8464-4932feea5c0f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:08.985084 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd99dce2-7b80-432f-8464-4932feea5c0f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:08.985775 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd99dce2-7b80-432f-8464-4932feea5c0f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:08.986236 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd99dce2-7b80-432f-8464-4932feea5c0f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:08.986659 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-cd99dce2-7b80-432f-8464-4932feea5c0f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:09.121070 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-cd99dce2-7b80-432f-8464-4932feea5c0f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:09.128671 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-cd99dce2-7b80-432f-8464-4932feea5c0f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.156195 Aug 24 09:09:09.129226 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 628/1305] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:08 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:09.243245 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8612338f-c575-4c8b-bbc8-ae7fde16a174 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:09.243852 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8612338f-c575-4c8b-bbc8-ae7fde16a174 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:09.250321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8612338f-c575-4c8b-bbc8-ae7fde16a174 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:09.250804 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8612338f-c575-4c8b-bbc8-ae7fde16a174 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:09.251243 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8612338f-c575-4c8b-bbc8-ae7fde16a174 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:09.251934 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8612338f-c575-4c8b-bbc8-ae7fde16a174 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:09.252427 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8612338f-c575-4c8b-bbc8-ae7fde16a174 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:09.252856 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8612338f-c575-4c8b-bbc8-ae7fde16a174 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:09.388444 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8612338f-c575-4c8b-bbc8-ae7fde16a174 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:09.396241 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8612338f-c575-4c8b-bbc8-ae7fde16a174 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1578 microversion: 2.1 time: 0.157120 Aug 24 09:09:09.396860 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 678/1306] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:09 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:10.150311 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-46292c5f-dbe7-42b9-8220-0070cea64d37 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:10.150944 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-46292c5f-dbe7-42b9-8220-0070cea64d37 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:10.157404 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46292c5f-dbe7-42b9-8220-0070cea64d37 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:10.157882 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46292c5f-dbe7-42b9-8220-0070cea64d37 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:10.158308 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46292c5f-dbe7-42b9-8220-0070cea64d37 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:10.158987 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46292c5f-dbe7-42b9-8220-0070cea64d37 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:10.159434 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46292c5f-dbe7-42b9-8220-0070cea64d37 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:10.159879 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-46292c5f-dbe7-42b9-8220-0070cea64d37 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:10.292236 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-46292c5f-dbe7-42b9-8220-0070cea64d37 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:10.299855 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-46292c5f-dbe7-42b9-8220-0070cea64d37 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.154117 Aug 24 09:09:10.300447 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 629/1307] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:10 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:09:10.417025 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-553b383f-cace-4745-a8eb-a51f68b01bd1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:10.417642 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-553b383f-cace-4745-a8eb-a51f68b01bd1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:10.423994 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-553b383f-cace-4745-a8eb-a51f68b01bd1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:10.424528 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-553b383f-cace-4745-a8eb-a51f68b01bd1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:10.424967 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-553b383f-cace-4745-a8eb-a51f68b01bd1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:10.425665 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-553b383f-cace-4745-a8eb-a51f68b01bd1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:10.426153 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-553b383f-cace-4745-a8eb-a51f68b01bd1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:10.426585 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-553b383f-cace-4745-a8eb-a51f68b01bd1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:10.556332 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-553b383f-cace-4745-a8eb-a51f68b01bd1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:10.564113 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-553b383f-cace-4745-a8eb-a51f68b01bd1 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1578 microversion: 2.1 time: 0.150958 Aug 24 09:09:10.564688 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 679/1308] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:10 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:11.321289 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-056b3ee4-0933-48eb-95d9-a4943569fe82 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:11.321904 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-056b3ee4-0933-48eb-95d9-a4943569fe82 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:11.328322 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-056b3ee4-0933-48eb-95d9-a4943569fe82 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:11.328808 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-056b3ee4-0933-48eb-95d9-a4943569fe82 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:11.329246 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-056b3ee4-0933-48eb-95d9-a4943569fe82 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:11.329941 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-056b3ee4-0933-48eb-95d9-a4943569fe82 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:11.330401 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-056b3ee4-0933-48eb-95d9-a4943569fe82 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:11.330857 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-056b3ee4-0933-48eb-95d9-a4943569fe82 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:11.464357 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-056b3ee4-0933-48eb-95d9-a4943569fe82 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:11.472269 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-056b3ee4-0933-48eb-95d9-a4943569fe82 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.155563 Aug 24 09:09:11.472834 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 630/1309] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:11 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:11.586213 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8fde3d2c-79fe-4aba-b143-30e2069e0b95 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:11.586824 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8fde3d2c-79fe-4aba-b143-30e2069e0b95 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:11.593268 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fde3d2c-79fe-4aba-b143-30e2069e0b95 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:11.593748 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fde3d2c-79fe-4aba-b143-30e2069e0b95 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:11.594184 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fde3d2c-79fe-4aba-b143-30e2069e0b95 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:11.594871 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fde3d2c-79fe-4aba-b143-30e2069e0b95 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:11.595323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fde3d2c-79fe-4aba-b143-30e2069e0b95 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:11.596048 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8fde3d2c-79fe-4aba-b143-30e2069e0b95 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:11.729718 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8fde3d2c-79fe-4aba-b143-30e2069e0b95 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:11.737930 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8fde3d2c-79fe-4aba-b143-30e2069e0b95 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1578 microversion: 2.1 time: 0.155731 Aug 24 09:09:11.738498 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 680/1310] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:11 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:12.492137 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-f50bc9f9-158c-43e3-8eae-64760c739311 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:12.492753 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-f50bc9f9-158c-43e3-8eae-64760c739311 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:12.499104 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f50bc9f9-158c-43e3-8eae-64760c739311 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:12.499581 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f50bc9f9-158c-43e3-8eae-64760c739311 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:12.500011 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f50bc9f9-158c-43e3-8eae-64760c739311 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:12.500716 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f50bc9f9-158c-43e3-8eae-64760c739311 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:12.501167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f50bc9f9-158c-43e3-8eae-64760c739311 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:12.501586 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-f50bc9f9-158c-43e3-8eae-64760c739311 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:12.627373 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-f50bc9f9-158c-43e3-8eae-64760c739311 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:12.635101 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-f50bc9f9-158c-43e3-8eae-64760c739311 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.146917 Aug 24 09:09:12.635653 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 631/1311] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:12 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:12.759338 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e21723e9-f9b1-4fdb-ab3c-efa4915bd06e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:12.759949 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e21723e9-f9b1-4fdb-ab3c-efa4915bd06e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:12.767748 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e21723e9-f9b1-4fdb-ab3c-efa4915bd06e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:12.768255 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e21723e9-f9b1-4fdb-ab3c-efa4915bd06e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:12.768688 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e21723e9-f9b1-4fdb-ab3c-efa4915bd06e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:12.769375 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e21723e9-f9b1-4fdb-ab3c-efa4915bd06e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:12.769829 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e21723e9-f9b1-4fdb-ab3c-efa4915bd06e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:12.770250 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e21723e9-f9b1-4fdb-ab3c-efa4915bd06e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:12.908900 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e21723e9-f9b1-4fdb-ab3c-efa4915bd06e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:12.916520 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e21723e9-f9b1-4fdb-ab3c-efa4915bd06e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1578 microversion: 2.1 time: 0.161528 Aug 24 09:09:12.917083 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 681/1312] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:12 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:13.656391 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-325fbab8-91d8-421a-b9cd-ef79fb9cbaed tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:13.657006 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-325fbab8-91d8-421a-b9cd-ef79fb9cbaed tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:13.664122 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-325fbab8-91d8-421a-b9cd-ef79fb9cbaed tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:13.664610 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-325fbab8-91d8-421a-b9cd-ef79fb9cbaed tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:13.665047 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-325fbab8-91d8-421a-b9cd-ef79fb9cbaed tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:13.665739 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-325fbab8-91d8-421a-b9cd-ef79fb9cbaed tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:13.666189 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-325fbab8-91d8-421a-b9cd-ef79fb9cbaed tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:13.666613 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-325fbab8-91d8-421a-b9cd-ef79fb9cbaed tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:13.796554 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-325fbab8-91d8-421a-b9cd-ef79fb9cbaed tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:13.800152 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:13.806011 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-325fbab8-91d8-421a-b9cd-ef79fb9cbaed tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.153590 Aug 24 09:09:13.806593 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 632/1313] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:13 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:13.937454 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-e90596e6-9cc1-41be-8f7f-a31063e950d8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:13.937988 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-e90596e6-9cc1-41be-8f7f-a31063e950d8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:13.945142 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e90596e6-9cc1-41be-8f7f-a31063e950d8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:13.945687 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e90596e6-9cc1-41be-8f7f-a31063e950d8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:13.946130 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e90596e6-9cc1-41be-8f7f-a31063e950d8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:13.946835 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e90596e6-9cc1-41be-8f7f-a31063e950d8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:13.947292 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e90596e6-9cc1-41be-8f7f-a31063e950d8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:13.947719 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-e90596e6-9cc1-41be-8f7f-a31063e950d8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:14.261726 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-e90596e6-9cc1-41be-8f7f-a31063e950d8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:14.265317 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=100 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:14.270506 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-e90596e6-9cc1-41be-8f7f-a31063e950d8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1578 microversion: 2.1 time: 0.337162 Aug 24 09:09:14.271060 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 682/1314] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:13 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1578 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:14.828382 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-5184243c-6e81-47d6-a40a-40c9267816a5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:14.829049 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-5184243c-6e81-47d6-a40a-40c9267816a5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:14.837046 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5184243c-6e81-47d6-a40a-40c9267816a5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:14.837542 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5184243c-6e81-47d6-a40a-40c9267816a5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:14.837981 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5184243c-6e81-47d6-a40a-40c9267816a5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:14.838788 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5184243c-6e81-47d6-a40a-40c9267816a5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:14.839247 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5184243c-6e81-47d6-a40a-40c9267816a5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:14.839671 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-5184243c-6e81-47d6-a40a-40c9267816a5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:15.072029 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-5184243c-6e81-47d6-a40a-40c9267816a5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:15.079663 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-5184243c-6e81-47d6-a40a-40c9267816a5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.256572 Aug 24 09:09:15.080467 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 633/1315] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:14 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:15.194164 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-02d8f15e-1671-4b98-9f15-5991f70f9c41 req-053f9106-2b2f-4e6e-9b88-7da5ddebf970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d57831c4-c9d8-4d05-97fb-e0bc7194aa91", "tag": "467245bc-1a7c-4b72-99df-9f2fe2bf442f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:09:15.205768 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-02d8f15e-1671-4b98-9f15-5991f70f9c41 req-053f9106-2b2f-4e6e-9b88-7da5ddebf970 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:15.210323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-02d8f15e-1671-4b98-9f15-5991f70f9c41 req-053f9106-2b2f-4e6e-9b88-7da5ddebf970 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:15.210876 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-02d8f15e-1671-4b98-9f15-5991f70f9c41 req-053f9106-2b2f-4e6e-9b88-7da5ddebf970 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:15.228070 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-02d8f15e-1671-4b98-9f15-5991f70f9c41 req-053f9106-2b2f-4e6e-9b88-7da5ddebf970 service nova] Creating event network-changed:467245bc-1a7c-4b72-99df-9f2fe2bf442f for instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 on hv-cinder-83538 Aug 24 09:09:15.234578 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-02d8f15e-1671-4b98-9f15-5991f70f9c41 req-053f9106-2b2f-4e6e-9b88-7da5ddebf970 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044785 Aug 24 09:09:15.235323 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 683/1316] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:09:15.293322 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-56e63be9-c4a6-4f06-a3d7-7b775d6c9de3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:15.293943 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-56e63be9-c4a6-4f06-a3d7-7b775d6c9de3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:15.300440 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56e63be9-c4a6-4f06-a3d7-7b775d6c9de3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:15.301407 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56e63be9-c4a6-4f06-a3d7-7b775d6c9de3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:15.302067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56e63be9-c4a6-4f06-a3d7-7b775d6c9de3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:15.303631 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56e63be9-c4a6-4f06-a3d7-7b775d6c9de3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:15.304496 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56e63be9-c4a6-4f06-a3d7-7b775d6c9de3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:15.305171 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-56e63be9-c4a6-4f06-a3d7-7b775d6c9de3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:15.661598 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-56e63be9-c4a6-4f06-a3d7-7b775d6c9de3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:15.670421 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-56e63be9-c4a6-4f06-a3d7-7b775d6c9de3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1459 microversion: 2.1 time: 0.382224 Aug 24 09:09:15.670989 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 634/1317] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:15 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1459 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:09:16.101611 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b8a6be6c-ba98-41ea-a8d6-80a39bff471a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:16.102313 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b8a6be6c-ba98-41ea-a8d6-80a39bff471a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:16.108637 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8a6be6c-ba98-41ea-a8d6-80a39bff471a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:16.109138 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8a6be6c-ba98-41ea-a8d6-80a39bff471a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:16.109567 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8a6be6c-ba98-41ea-a8d6-80a39bff471a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:16.110259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8a6be6c-ba98-41ea-a8d6-80a39bff471a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:16.110718 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8a6be6c-ba98-41ea-a8d6-80a39bff471a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:16.111146 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b8a6be6c-ba98-41ea-a8d6-80a39bff471a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:16.246325 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b8a6be6c-ba98-41ea-a8d6-80a39bff471a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:16.254008 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b8a6be6c-ba98-41ea-a8d6-80a39bff471a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.156834 Aug 24 09:09:16.254595 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 684/1318] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:16 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:16.692482 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-37b20c1a-40bf-4a6f-8471-5e5f3efea6c0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:16.693130 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-37b20c1a-40bf-4a6f-8471-5e5f3efea6c0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:16.695470 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:16.701144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37b20c1a-40bf-4a6f-8471-5e5f3efea6c0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:16.701756 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37b20c1a-40bf-4a6f-8471-5e5f3efea6c0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:16.702261 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37b20c1a-40bf-4a6f-8471-5e5f3efea6c0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:16.703009 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37b20c1a-40bf-4a6f-8471-5e5f3efea6c0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:16.703474 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37b20c1a-40bf-4a6f-8471-5e5f3efea6c0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:16.703906 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-37b20c1a-40bf-4a6f-8471-5e5f3efea6c0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:16.775430 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-37b20c1a-40bf-4a6f-8471-5e5f3efea6c0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:16.783298 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-37b20c1a-40bf-4a6f-8471-5e5f3efea6c0 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1391 microversion: 2.1 time: 0.094852 Aug 24 09:09:16.783863 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 635/1319] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:16 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1391 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:17.258482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-92b3f653-c08c-4863-aa1d-b57888daa7e6 req-dc6542e1-2482-4287-8383-b721be1fe23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "305f45c9-6610-45f1-ba0b-96088c32bdbd", "name": "network-vif-deleted", "tag": "3e1c506d-5244-4f4d-87cb-d02d5c2acbde"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:09:17.263709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:17.270142 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-92b3f653-c08c-4863-aa1d-b57888daa7e6 req-dc6542e1-2482-4287-8383-b721be1fe23e service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:17.270618 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-92b3f653-c08c-4863-aa1d-b57888daa7e6 req-dc6542e1-2482-4287-8383-b721be1fe23e service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:17.271793 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-92b3f653-c08c-4863-aa1d-b57888daa7e6 req-dc6542e1-2482-4287-8383-b721be1fe23e service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:17.276267 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-e86c4748-edf2-4968-83d9-3546bd169bcd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:17.276892 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-e86c4748-edf2-4968-83d9-3546bd169bcd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:17.282729 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e86c4748-edf2-4968-83d9-3546bd169bcd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:17.283228 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e86c4748-edf2-4968-83d9-3546bd169bcd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:17.283559 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-92b3f653-c08c-4863-aa1d-b57888daa7e6 req-dc6542e1-2482-4287-8383-b721be1fe23e service nova] Creating event network-vif-deleted:3e1c506d-5244-4f4d-87cb-d02d5c2acbde for instance 305f45c9-6610-45f1-ba0b-96088c32bdbd on hv-cinder-83538 Aug 24 09:09:17.283675 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e86c4748-edf2-4968-83d9-3546bd169bcd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:17.284366 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e86c4748-edf2-4968-83d9-3546bd169bcd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:17.284828 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e86c4748-edf2-4968-83d9-3546bd169bcd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:17.285262 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-e86c4748-edf2-4968-83d9-3546bd169bcd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:17.288403 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-92b3f653-c08c-4863-aa1d-b57888daa7e6 req-dc6542e1-2482-4287-8383-b721be1fe23e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034229 Aug 24 09:09:17.288991 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 685/1320] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:09:17.417181 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-e86c4748-edf2-4968-83d9-3546bd169bcd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:17.424757 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-e86c4748-edf2-4968-83d9-3546bd169bcd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.153407 Aug 24 09:09:17.425312 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 636/1321] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:17 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:09:17.806099 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b18f4d6f-a9d3-45e2-a3ad-436828e4a7bc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:17.806825 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b18f4d6f-a9d3-45e2-a3ad-436828e4a7bc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:17.814867 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b18f4d6f-a9d3-45e2-a3ad-436828e4a7bc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:17.815348 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b18f4d6f-a9d3-45e2-a3ad-436828e4a7bc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:17.815806 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b18f4d6f-a9d3-45e2-a3ad-436828e4a7bc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:17.816552 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b18f4d6f-a9d3-45e2-a3ad-436828e4a7bc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:17.817004 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b18f4d6f-a9d3-45e2-a3ad-436828e4a7bc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:17.817425 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b18f4d6f-a9d3-45e2-a3ad-436828e4a7bc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:17.881909 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b18f4d6f-a9d3-45e2-a3ad-436828e4a7bc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:17.889631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b18f4d6f-a9d3-45e2-a3ad-436828e4a7bc tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1391 microversion: 2.1 time: 0.088484 Aug 24 09:09:17.890189 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 686/1322] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:17 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1391 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:18.448949 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3d72734d-5f52-4bd1-b664-a5c5729675e5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:18.449756 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3d72734d-5f52-4bd1-b664-a5c5729675e5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:18.459233 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d72734d-5f52-4bd1-b664-a5c5729675e5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:18.460203 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d72734d-5f52-4bd1-b664-a5c5729675e5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:18.460897 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d72734d-5f52-4bd1-b664-a5c5729675e5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:18.461847 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d72734d-5f52-4bd1-b664-a5c5729675e5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:18.462521 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d72734d-5f52-4bd1-b664-a5c5729675e5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:18.463177 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3d72734d-5f52-4bd1-b664-a5c5729675e5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:18.677313 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-3d72734d-5f52-4bd1-b664-a5c5729675e5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:18.685795 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3d72734d-5f52-4bd1-b664-a5c5729675e5 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.244036 Aug 24 09:09:18.686369 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 637/1323] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:18 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:18.910406 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-b0533dac-c0a8-4cca-b857-62c8de9085b6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:18.911090 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-b0533dac-c0a8-4cca-b857-62c8de9085b6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:18.917590 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0533dac-c0a8-4cca-b857-62c8de9085b6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:18.918072 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0533dac-c0a8-4cca-b857-62c8de9085b6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:18.918510 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0533dac-c0a8-4cca-b857-62c8de9085b6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:18.919204 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0533dac-c0a8-4cca-b857-62c8de9085b6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:18.919662 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0533dac-c0a8-4cca-b857-62c8de9085b6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:18.920088 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0533dac-c0a8-4cca-b857-62c8de9085b6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:18.950345 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0533dac-c0a8-4cca-b857-62c8de9085b6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:18.950827 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0533dac-c0a8-4cca-b857-62c8de9085b6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:18.951261 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-b0533dac-c0a8-4cca-b857-62c8de9085b6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:18.951702 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-b0533dac-c0a8-4cca-b857-62c8de9085b6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lazy-loading 'fault' on Instance uuid 305f45c9-6610-45f1-ba0b-96088c32bdbd {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:09:18.993072 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-b0533dac-c0a8-4cca-b857-62c8de9085b6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:19.000686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-b0533dac-c0a8-4cca-b857-62c8de9085b6 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 200 len: 1231 microversion: 2.1 time: 0.094099 Aug 24 09:09:19.001246 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 687/1324] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:18 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:19.706872 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-0b8afb21-3597-463e-83dc-cb7c89e2ca2a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:19.707476 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-0b8afb21-3597-463e-83dc-cb7c89e2ca2a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:19.714679 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b8afb21-3597-463e-83dc-cb7c89e2ca2a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:19.715162 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b8afb21-3597-463e-83dc-cb7c89e2ca2a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:19.715592 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b8afb21-3597-463e-83dc-cb7c89e2ca2a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:19.716307 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b8afb21-3597-463e-83dc-cb7c89e2ca2a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:19.716758 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b8afb21-3597-463e-83dc-cb7c89e2ca2a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:19.717184 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-0b8afb21-3597-463e-83dc-cb7c89e2ca2a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:19.849079 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-0b8afb21-3597-463e-83dc-cb7c89e2ca2a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:19.861153 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-0b8afb21-3597-463e-83dc-cb7c89e2ca2a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.155896 Aug 24 09:09:19.861731 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 638/1325] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:19 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:20.021935 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f559c189-3856-427d-a574-7cc14f73a5e3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:20.022475 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-f559c189-3856-427d-a574-7cc14f73a5e3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 305f45c9-6610-45f1-ba0b-96088c32bdbd] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:20.029030 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f559c189-3856-427d-a574-7cc14f73a5e3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:20.029520 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f559c189-3856-427d-a574-7cc14f73a5e3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:20.029963 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f559c189-3856-427d-a574-7cc14f73a5e3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:20.030660 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f559c189-3856-427d-a574-7cc14f73a5e3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:20.031130 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f559c189-3856-427d-a574-7cc14f73a5e3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:20.031561 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-f559c189-3856-427d-a574-7cc14f73a5e3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:20.044981 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-f559c189-3856-427d-a574-7cc14f73a5e3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] HTTP exception thrown: Instance 305f45c9-6610-45f1-ba0b-96088c32bdbd could not be found. Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f559c189-3856-427d-a574-7cc14f73a5e3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Request method failure captured: Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd HTTP/1.1 Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBehQP1-444gnAzmK9UQR4_th7rQi9XkjPsGddXguVxoM6DfO-6Y6_ugun1cxR9pwbQU4JgRB7flDoSVAyavcw1wGkpOoK3OpeevRkCHbiSiOygkHn6SfhueR2e25MkBBDyhsNp-eP8UN9VZ76jrnXAkSpDI44B_q4oCM73ny0HXP3Zc Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 080318594f144fa3852577bc02ee5357 Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-TestVolumeBootPattern-9404766 Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:09:20.046591 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:09:20.048394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_080318594f144fa3852577bc02ee5357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/080318594f144fa3852577bc02ee5357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/080318594f144fa3852577bc02ee5357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/080318594f144fa3852577bc02ee5357"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:09:20.048394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-TestVolumeBootPattern-9404766 Aug 24 09:09:20.048394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 080318594f144fa3852577bc02ee5357 Aug 24 09:09:20.048394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestVolumeBootPattern-9404766 Aug 24 09:09:20.048394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-TestVolumeBootPattern-9404766-project Aug 24 09:09:20.048394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:09:20.048394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:09:20.048394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: 46b3aa99a5e84ef2a8df193628feb0d6 Aug 24 09:09:20.048394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-TestVolumeBootPattern-9404766-project Aug 24 09:09:20.048394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:09:20.048394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance 305f45c9-6610-45f1-ba0b-96088c32bdbd could not be found. Aug 24 09:09:20.048394 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '305f45c9-6610-45f1-ba0b-96088c32bdbd'} Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 305f45c9-6610-45f1-ba0b-96088c32bdbd could not be found. Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:09:20.049414 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 305f45c9-6610-45f1-ba0b-96088c32bdbd could not be found. Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 305f45c9-6610-45f1-ba0b-96088c32bdbd could not be found. Aug 24 09:09:20.051081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:09:20.053192 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f559c189-3856-427d-a574-7cc14f73a5e3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Returning 404 to user: Instance 305f45c9-6610-45f1-ba0b-96088c32bdbd could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:09:20.053192 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f559c189-3856-427d-a574-7cc14f73a5e3 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd" status: 404 len: 111 microversion: 2.1 time: 0.030093 Aug 24 09:09:20.053192 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 688/1326] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:20 2022] GET /compute/v2.1/servers/305f45c9-6610-45f1-ba0b-96088c32bdbd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:09:20.885171 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-6aae7e25-e14d-4ebf-a01f-5da379ff5c8b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:20.885800 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-6aae7e25-e14d-4ebf-a01f-5da379ff5c8b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:20.892321 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6aae7e25-e14d-4ebf-a01f-5da379ff5c8b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:20.892811 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6aae7e25-e14d-4ebf-a01f-5da379ff5c8b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:20.893251 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6aae7e25-e14d-4ebf-a01f-5da379ff5c8b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:20.893957 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6aae7e25-e14d-4ebf-a01f-5da379ff5c8b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:20.894417 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6aae7e25-e14d-4ebf-a01f-5da379ff5c8b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:20.894837 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-6aae7e25-e14d-4ebf-a01f-5da379ff5c8b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:21.022512 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-6aae7e25-e14d-4ebf-a01f-5da379ff5c8b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:21.030141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-6aae7e25-e14d-4ebf-a01f-5da379ff5c8b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.148919 Aug 24 09:09:21.030705 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 639/1327] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:20 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:09:22.051565 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4a3806d8-d684-45e0-81a5-b76d41e118f0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:22.052241 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4a3806d8-d684-45e0-81a5-b76d41e118f0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:22.058598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a3806d8-d684-45e0-81a5-b76d41e118f0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:22.059074 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a3806d8-d684-45e0-81a5-b76d41e118f0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:22.059504 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a3806d8-d684-45e0-81a5-b76d41e118f0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:22.060226 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a3806d8-d684-45e0-81a5-b76d41e118f0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:22.060678 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a3806d8-d684-45e0-81a5-b76d41e118f0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:22.061099 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4a3806d8-d684-45e0-81a5-b76d41e118f0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:22.189621 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-4a3806d8-d684-45e0-81a5-b76d41e118f0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:22.197977 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4a3806d8-d684-45e0-81a5-b76d41e118f0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.150851 Aug 24 09:09:22.198535 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 689/1328] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:22 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:22.570573 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-55742c8b-466a-47fc-8b04-248685fbdab1 req-6cf2917f-0639-47f1-9bb3-587020303557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d57831c4-c9d8-4d05-97fb-e0bc7194aa91", "name": "network-vif-plugged", "status": "completed", "tag": "467245bc-1a7c-4b72-99df-9f2fe2bf442f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:09:22.580356 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-55742c8b-466a-47fc-8b04-248685fbdab1 req-6cf2917f-0639-47f1-9bb3-587020303557 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:22.581455 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-55742c8b-466a-47fc-8b04-248685fbdab1 req-6cf2917f-0639-47f1-9bb3-587020303557 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:22.581968 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-55742c8b-466a-47fc-8b04-248685fbdab1 req-6cf2917f-0639-47f1-9bb3-587020303557 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:22.594780 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-55742c8b-466a-47fc-8b04-248685fbdab1 req-6cf2917f-0639-47f1-9bb3-587020303557 service nova] Creating event network-vif-plugged:467245bc-1a7c-4b72-99df-9f2fe2bf442f for instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 on hv-cinder-83538 Aug 24 09:09:22.600485 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-55742c8b-466a-47fc-8b04-248685fbdab1 req-6cf2917f-0639-47f1-9bb3-587020303557 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159483 Aug 24 09:09:22.601172 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 640/1329] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:09:23.149630 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9ccfe737-495f-4c28-87a8-920b55ce74ee tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:23.150141 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9ccfe737-495f-4c28-87a8-920b55ce74ee tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:23.152431 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-4c011cb6-bb5e-4131-9d4e-61b894db853a req-f1aec5aa-466d-4940-9542-ea2f46e2f914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "442e038a-9739-4d4f-8e15-29230d79980e", "tag": "cde16a80-8a4a-4243-8358-2c2b63d48c1b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:09:23.156814 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ccfe737-495f-4c28-87a8-920b55ce74ee tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:23.157432 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ccfe737-495f-4c28-87a8-920b55ce74ee tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:23.158156 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ccfe737-495f-4c28-87a8-920b55ce74ee tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:23.159035 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ccfe737-495f-4c28-87a8-920b55ce74ee tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:23.159664 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ccfe737-495f-4c28-87a8-920b55ce74ee tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:23.160121 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9ccfe737-495f-4c28-87a8-920b55ce74ee tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:23.163692 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4c011cb6-bb5e-4131-9d4e-61b894db853a req-f1aec5aa-466d-4940-9542-ea2f46e2f914 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:23.164282 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4c011cb6-bb5e-4131-9d4e-61b894db853a req-f1aec5aa-466d-4940-9542-ea2f46e2f914 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:23.164803 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-4c011cb6-bb5e-4131-9d4e-61b894db853a req-f1aec5aa-466d-4940-9542-ea2f46e2f914 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:23.176723 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-4c011cb6-bb5e-4131-9d4e-61b894db853a req-f1aec5aa-466d-4940-9542-ea2f46e2f914 service nova] Creating event network-changed:cde16a80-8a4a-4243-8358-2c2b63d48c1b for instance 442e038a-9739-4d4f-8e15-29230d79980e on hv-cinder-83538 Aug 24 09:09:23.181770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-4c011cb6-bb5e-4131-9d4e-61b894db853a req-f1aec5aa-466d-4940-9542-ea2f46e2f914 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033569 Aug 24 09:09:23.182638 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 641/1330] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:09:23.189541 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9ccfe737-495f-4c28-87a8-920b55ce74ee tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:09:23.231146 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-afd725df-65a6-4605-b21a-af0764e036ec tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:23.231859 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-afd725df-65a6-4605-b21a-af0764e036ec tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:23.238765 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afd725df-65a6-4605-b21a-af0764e036ec tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:23.240331 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afd725df-65a6-4605-b21a-af0764e036ec tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:23.241549 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afd725df-65a6-4605-b21a-af0764e036ec tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:23.243596 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afd725df-65a6-4605-b21a-af0764e036ec tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:23.245850 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afd725df-65a6-4605-b21a-af0764e036ec tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:23.246479 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-afd725df-65a6-4605-b21a-af0764e036ec tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:23.278251 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9ccfe737-495f-4c28-87a8-920b55ce74ee tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "DELETE /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 204 len: 0 microversion: 2.1 time: 0.132725 Aug 24 09:09:23.279406 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 690/1331] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:09:23 2022] DELETE /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:09:23.288212 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-3d186870-0ca7-42e8-a1d8-3be175954f4f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:23.288918 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-3d186870-0ca7-42e8-a1d8-3be175954f4f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:23.295046 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d186870-0ca7-42e8-a1d8-3be175954f4f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:23.295564 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d186870-0ca7-42e8-a1d8-3be175954f4f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:23.296005 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d186870-0ca7-42e8-a1d8-3be175954f4f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:23.296731 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d186870-0ca7-42e8-a1d8-3be175954f4f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:23.297191 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d186870-0ca7-42e8-a1d8-3be175954f4f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:23.297620 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-3d186870-0ca7-42e8-a1d8-3be175954f4f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:23.455068 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-afd725df-65a6-4605-b21a-af0764e036ec tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:23.463595 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-afd725df-65a6-4605-b21a-af0764e036ec tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.241280 Aug 24 09:09:23.464458 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 642/1332] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:23 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:23.480897 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-3d186870-0ca7-42e8-a1d8-3be175954f4f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:23.489039 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-3d186870-0ca7-42e8-a1d8-3be175954f4f tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1578 microversion: 2.1 time: 0.205071 Aug 24 09:09:23.489536 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 691/1333] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:23 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1578 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:24.484980 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-a730a552-f12d-40ca-be68-c3f45ebba496 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:24.485628 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-a730a552-f12d-40ca-be68-c3f45ebba496 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:24.492626 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a730a552-f12d-40ca-be68-c3f45ebba496 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:24.493116 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a730a552-f12d-40ca-be68-c3f45ebba496 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:24.493739 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a730a552-f12d-40ca-be68-c3f45ebba496 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:24.494447 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a730a552-f12d-40ca-be68-c3f45ebba496 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:24.494906 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a730a552-f12d-40ca-be68-c3f45ebba496 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:24.495337 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-a730a552-f12d-40ca-be68-c3f45ebba496 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:24.510644 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2b1ea942-780b-4f93-bfd9-2f3cc6f3af2e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:24.511182 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2b1ea942-780b-4f93-bfd9-2f3cc6f3af2e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:24.517533 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1ea942-780b-4f93-bfd9-2f3cc6f3af2e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:24.518017 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1ea942-780b-4f93-bfd9-2f3cc6f3af2e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:24.518449 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1ea942-780b-4f93-bfd9-2f3cc6f3af2e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:24.519133 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1ea942-780b-4f93-bfd9-2f3cc6f3af2e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:24.519594 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1ea942-780b-4f93-bfd9-2f3cc6f3af2e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:24.520012 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2b1ea942-780b-4f93-bfd9-2f3cc6f3af2e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:24.716638 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-a730a552-f12d-40ca-be68-c3f45ebba496 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:24.725487 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-a730a552-f12d-40ca-be68-c3f45ebba496 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1358 microversion: 2.1 time: 0.244372 Aug 24 09:09:24.726067 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 643/1334] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:24 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:24.735555 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2b1ea942-780b-4f93-bfd9-2f3cc6f3af2e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:24.748237 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2b1ea942-780b-4f93-bfd9-2f3cc6f3af2e tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1578 microversion: 2.1 time: 0.241402 Aug 24 09:09:24.748819 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 692/1335] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:24 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1578 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:09:25.230290 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-55154c96-6eed-4239-b08b-7c807a2e5785 req-12ec7ef5-648c-4019-a68b-ed45c347cd7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "442e038a-9739-4d4f-8e15-29230d79980e", "name": "network-vif-deleted", "tag": "cde16a80-8a4a-4243-8358-2c2b63d48c1b"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:09:25.240066 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-55154c96-6eed-4239-b08b-7c807a2e5785 req-12ec7ef5-648c-4019-a68b-ed45c347cd7e service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:25.240571 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-55154c96-6eed-4239-b08b-7c807a2e5785 req-12ec7ef5-648c-4019-a68b-ed45c347cd7e service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:25.241214 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-55154c96-6eed-4239-b08b-7c807a2e5785 req-12ec7ef5-648c-4019-a68b-ed45c347cd7e service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:25.252419 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-55154c96-6eed-4239-b08b-7c807a2e5785 req-12ec7ef5-648c-4019-a68b-ed45c347cd7e service nova] Creating event network-vif-deleted:cde16a80-8a4a-4243-8358-2c2b63d48c1b for instance 442e038a-9739-4d4f-8e15-29230d79980e on hv-cinder-83538 Aug 24 09:09:25.258199 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-55154c96-6eed-4239-b08b-7c807a2e5785 req-12ec7ef5-648c-4019-a68b-ed45c347cd7e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031779 Aug 24 09:09:25.258825 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 644/1336] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:09:25.747582 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-4b6336dc-ceb8-4f70-9601-87af6ada2b58 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:25.748365 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-4b6336dc-ceb8-4f70-9601-87af6ada2b58 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:25.755718 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b6336dc-ceb8-4f70-9601-87af6ada2b58 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:25.756180 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b6336dc-ceb8-4f70-9601-87af6ada2b58 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:25.756624 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b6336dc-ceb8-4f70-9601-87af6ada2b58 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:25.757328 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b6336dc-ceb8-4f70-9601-87af6ada2b58 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:25.757789 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b6336dc-ceb8-4f70-9601-87af6ada2b58 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:25.758233 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-4b6336dc-ceb8-4f70-9601-87af6ada2b58 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:25.773141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-123b807a-aa16-4b7f-b4e8-d4ce13305338 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:25.773862 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-123b807a-aa16-4b7f-b4e8-d4ce13305338 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:25.780071 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-123b807a-aa16-4b7f-b4e8-d4ce13305338 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:25.780595 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-123b807a-aa16-4b7f-b4e8-d4ce13305338 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:25.781032 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-123b807a-aa16-4b7f-b4e8-d4ce13305338 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:25.781734 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-123b807a-aa16-4b7f-b4e8-d4ce13305338 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:25.782188 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-123b807a-aa16-4b7f-b4e8-d4ce13305338 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:25.782622 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-123b807a-aa16-4b7f-b4e8-d4ce13305338 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:25.817413 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-123b807a-aa16-4b7f-b4e8-d4ce13305338 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:25.818141 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-123b807a-aa16-4b7f-b4e8-d4ce13305338 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:25.818814 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-123b807a-aa16-4b7f-b4e8-d4ce13305338 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:25.819294 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.objects.instance [None req-123b807a-aa16-4b7f-b4e8-d4ce13305338 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lazy-loading 'fault' on Instance uuid 442e038a-9739-4d4f-8e15-29230d79980e {{(pid=120543) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:09:25.869515 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-123b807a-aa16-4b7f-b4e8-d4ce13305338 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b3aa99a5e84ef2a8df193628feb0d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080318594f144fa3852577bc02ee5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:25.877830 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-123b807a-aa16-4b7f-b4e8-d4ce13305338 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 200 len: 1185 microversion: 2.1 time: 0.110365 Aug 24 09:09:25.878560 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 645/1337] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:25 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 1185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:25.929796 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-4b6336dc-ceb8-4f70-9601-87af6ada2b58 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:25.937493 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-4b6336dc-ceb8-4f70-9601-87af6ada2b58 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1547 microversion: 2.1 time: 0.193825 Aug 24 09:09:25.938064 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 693/1338] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:25 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1547 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:25.957730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d9d9ca7c-9f1a-45b6-a842-1709198f0f23 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:25.958345 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d9d9ca7c-9f1a-45b6-a842-1709198f0f23 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:25.964388 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9d9ca7c-9f1a-45b6-a842-1709198f0f23 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:25.964875 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9d9ca7c-9f1a-45b6-a842-1709198f0f23 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:25.965313 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9d9ca7c-9f1a-45b6-a842-1709198f0f23 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:25.966003 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9d9ca7c-9f1a-45b6-a842-1709198f0f23 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:25.966460 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9d9ca7c-9f1a-45b6-a842-1709198f0f23 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:25.966887 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d9d9ca7c-9f1a-45b6-a842-1709198f0f23 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:26.095470 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-d9d9ca7c-9f1a-45b6-a842-1709198f0f23 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:26.103824 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d9d9ca7c-9f1a-45b6-a842-1709198f0f23 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1547 microversion: 2.1 time: 0.150293 Aug 24 09:09:26.104417 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 646/1339] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:25 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:26.123686 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-2f84844f-eeb0-46de-9d31-259ccffb9f96 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:26.128442 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-2f84844f-eeb0-46de-9d31-259ccffb9f96 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:26.129238 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-2f84844f-eeb0-46de-9d31-259ccffb9f96 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Searching by: {'deleted': False, 'project_id': '759df091a0664e68b9f38eec1f9c2e49'} {{(pid=120542) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 09:09:26.135811 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f84844f-eeb0-46de-9d31-259ccffb9f96 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:26.136333 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f84844f-eeb0-46de-9d31-259ccffb9f96 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:26.136765 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f84844f-eeb0-46de-9d31-259ccffb9f96 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:26.137482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f84844f-eeb0-46de-9d31-259ccffb9f96 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:26.137932 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f84844f-eeb0-46de-9d31-259ccffb9f96 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:26.138354 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-2f84844f-eeb0-46de-9d31-259ccffb9f96 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:26.228716 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.multi_cell_list [None req-2f84844f-eeb0-46de-9d31-259ccffb9f96 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120542) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 09:09:26.321040 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-2f84844f-eeb0-46de-9d31-259ccffb9f96 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.201014 Aug 24 09:09:26.321532 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 694/1340] 10.222.0.67 () {58 vars in 1125 bytes} [Wed Aug 24 09:09:26 2022] GET /compute/v2.1/servers => generated 342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:09:26.333940 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-50c21c28-729e-4818-b966-c904de6fcd6d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:26.334568 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-50c21c28-729e-4818-b966-c904de6fcd6d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:26.341115 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50c21c28-729e-4818-b966-c904de6fcd6d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:26.341601 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50c21c28-729e-4818-b966-c904de6fcd6d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:26.342041 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50c21c28-729e-4818-b966-c904de6fcd6d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:26.342741 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50c21c28-729e-4818-b966-c904de6fcd6d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:26.343471 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50c21c28-729e-4818-b966-c904de6fcd6d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:26.343888 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-50c21c28-729e-4818-b966-c904de6fcd6d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:26.473390 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-50c21c28-729e-4818-b966-c904de6fcd6d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:26.481149 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-50c21c28-729e-4818-b966-c904de6fcd6d tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1547 microversion: 2.1 time: 0.152329 Aug 24 09:09:26.481715 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 647/1341] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:26 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:26.899409 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6607d10e-6de5-4cd5-9249-7b6e9a4618eb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:26.900020 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-6607d10e-6de5-4cd5-9249-7b6e9a4618eb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 442e038a-9739-4d4f-8e15-29230d79980e] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:26.906361 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6607d10e-6de5-4cd5-9249-7b6e9a4618eb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:26.906841 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6607d10e-6de5-4cd5-9249-7b6e9a4618eb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:26.907276 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6607d10e-6de5-4cd5-9249-7b6e9a4618eb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:26.907966 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6607d10e-6de5-4cd5-9249-7b6e9a4618eb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:26.908456 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6607d10e-6de5-4cd5-9249-7b6e9a4618eb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:26.908884 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-6607d10e-6de5-4cd5-9249-7b6e9a4618eb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:26.922115 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-6607d10e-6de5-4cd5-9249-7b6e9a4618eb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] HTTP exception thrown: Instance 442e038a-9739-4d4f-8e15-29230d79980e could not be found. Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6607d10e-6de5-4cd5-9249-7b6e9a4618eb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Request method failure captured: Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e HTTP/1.1 Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBehQP1-444gnAzmK9UQR4_th7rQi9XkjPsGddXguVxoM6DfO-6Y6_ugun1cxR9pwbQU4JgRB7flDoSVAyavcw1wGkpOoK3OpeevRkCHbiSiOygkHn6SfhueR2e25MkBBDyhsNp-eP8UN9VZ76jrnXAkSpDI44B_q4oCM73ny0HXP3Zc Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 080318594f144fa3852577bc02ee5357 Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-TestVolumeBootPattern-9404766 Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:09:26.923720 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:09:26.925420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_080318594f144fa3852577bc02ee5357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/080318594f144fa3852577bc02ee5357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/080318594f144fa3852577bc02ee5357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/080318594f144fa3852577bc02ee5357"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:09:26.925420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-TestVolumeBootPattern-9404766 Aug 24 09:09:26.925420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 080318594f144fa3852577bc02ee5357 Aug 24 09:09:26.925420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestVolumeBootPattern-9404766 Aug 24 09:09:26.925420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-TestVolumeBootPattern-9404766-project Aug 24 09:09:26.925420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:09:26.925420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:09:26.925420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: 46b3aa99a5e84ef2a8df193628feb0d6 Aug 24 09:09:26.925420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-TestVolumeBootPattern-9404766-project Aug 24 09:09:26.925420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:09:26.925420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance 442e038a-9739-4d4f-8e15-29230d79980e could not be found. Aug 24 09:09:26.925420 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '442e038a-9739-4d4f-8e15-29230d79980e'} Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 442e038a-9739-4d4f-8e15-29230d79980e could not be found. Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:09:26.926381 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 442e038a-9739-4d4f-8e15-29230d79980e could not be found. Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 442e038a-9739-4d4f-8e15-29230d79980e could not be found. Aug 24 09:09:26.928055 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:09:26.929503 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-6607d10e-6de5-4cd5-9249-7b6e9a4618eb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Returning 404 to user: Instance 442e038a-9739-4d4f-8e15-29230d79980e could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:09:26.929503 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-6607d10e-6de5-4cd5-9249-7b6e9a4618eb tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e" status: 404 len: 111 microversion: 2.1 time: 0.029667 Aug 24 09:09:26.929503 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 695/1342] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:26 2022] GET /compute/v2.1/servers/442e038a-9739-4d4f-8e15-29230d79980e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:09:27.361395 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b5882cf6-7c7c-4c4c-9709-86737b9f22c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:27.361915 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-b5882cf6-7c7c-4c4c-9709-86737b9f22c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:27.369132 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5882cf6-7c7c-4c4c-9709-86737b9f22c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:27.369684 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5882cf6-7c7c-4c4c-9709-86737b9f22c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:27.370121 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5882cf6-7c7c-4c4c-9709-86737b9f22c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:27.370815 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5882cf6-7c7c-4c4c-9709-86737b9f22c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:27.371274 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5882cf6-7c7c-4c4c-9709-86737b9f22c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:27.371697 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-b5882cf6-7c7c-4c4c-9709-86737b9f22c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:27.385268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-b5882cf6-7c7c-4c4c-9709-86737b9f22c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] HTTP exception thrown: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b5882cf6-7c7c-4c4c-9709-86737b9f22c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Request method failure captured: Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 HTTP/1.1 Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBehQP1-444gnAzmK9UQR4_th7rQi9XkjPsGddXguVxoM6DfO-6Y6_ugun1cxR9pwbQU4JgRB7flDoSVAyavcw1wGkpOoK3OpeevRkCHbiSiOygkHn6SfhueR2e25MkBBDyhsNp-eP8UN9VZ76jrnXAkSpDI44B_q4oCM73ny0HXP3Zc Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 080318594f144fa3852577bc02ee5357 Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-TestVolumeBootPattern-9404766 Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:09:27.386961 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:09:27.388711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_080318594f144fa3852577bc02ee5357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/080318594f144fa3852577bc02ee5357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/080318594f144fa3852577bc02ee5357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/080318594f144fa3852577bc02ee5357"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:09:27.388711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-TestVolumeBootPattern-9404766 Aug 24 09:09:27.388711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 080318594f144fa3852577bc02ee5357 Aug 24 09:09:27.388711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestVolumeBootPattern-9404766 Aug 24 09:09:27.388711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-TestVolumeBootPattern-9404766-project Aug 24 09:09:27.388711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:09:27.388711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:09:27.388711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: 46b3aa99a5e84ef2a8df193628feb0d6 Aug 24 09:09:27.388711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-TestVolumeBootPattern-9404766-project Aug 24 09:09:27.388711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:09:27.388711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. Aug 24 09:09:27.388711 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': '2dff703e-fd9a-4783-9b0d-98337571e993'} Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:09:27.389884 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. Aug 24 09:09:27.391501 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:09:27.393211 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-b5882cf6-7c7c-4c4c-9709-86737b9f22c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Returning 404 to user: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:09:27.393211 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-b5882cf6-7c7c-4c4c-9709-86737b9f22c8 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "DELETE /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 404 len: 111 microversion: 2.1 time: 0.030891 Aug 24 09:09:27.393211 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 648/1343] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:09:27 2022] DELETE /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:09:27.396887 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cd70e01d-64ed-4374-bb14-39e9eed00d45 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:27.397506 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-cd70e01d-64ed-4374-bb14-39e9eed00d45 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] [instance: 2dff703e-fd9a-4783-9b0d-98337571e993] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:27.403320 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd70e01d-64ed-4374-bb14-39e9eed00d45 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:27.403805 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd70e01d-64ed-4374-bb14-39e9eed00d45 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:27.404284 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd70e01d-64ed-4374-bb14-39e9eed00d45 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:27.404975 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd70e01d-64ed-4374-bb14-39e9eed00d45 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:27.405435 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd70e01d-64ed-4374-bb14-39e9eed00d45 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:27.405862 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-cd70e01d-64ed-4374-bb14-39e9eed00d45 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:27.419524 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.wsgi [None req-cd70e01d-64ed-4374-bb14-39e9eed00d45 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] HTTP exception thrown: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cd70e01d-64ed-4374-bb14-39e9eed00d45 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Request method failure captured: Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: request: GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 HTTP/1.1 Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept: application/json Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Accept-Encoding: identity Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Connection: close Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Length: 0 Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Content-Type: application/json Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Host: 10.222.0.67 Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Openstack-System-Scope: None Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: User-Agent: python-urllib3/1.26.11 Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Auth-Token: gAAAAABjBehQP1-444gnAzmK9UQR4_th7rQi9XkjPsGddXguVxoM6DfO-6Y6_ugun1cxR9pwbQU4JgRB7flDoSVAyavcw1wGkpOoK3OpeevRkCHbiSiOygkHn6SfhueR2e25MkBBDyhsNp-eP8UN9VZ76jrnXAkSpDI44B_q4oCM73ny0HXP3Zc Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Id: None Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Domain-Name: None Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Identity-Status: Confirmed Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Is-Admin-Project: True Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Id: default Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Domain-Name: Default Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Id: 080318594f144fa3852577bc02ee5357 Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Project-Name: tempest-TestVolumeBootPattern-9404766 Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Role: reader,member Aug 24 09:09:27.421045 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Roles: reader,member Aug 24 09:09:27.422803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_080318594f144fa3852577bc02ee5357"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/080318594f144fa3852577bc02ee5357"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/080318594f144fa3852577bc02ee5357"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/080318594f144fa3852577bc02ee5357"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:09:27.422803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant: tempest-TestVolumeBootPattern-9404766 Aug 24 09:09:27.422803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Id: 080318594f144fa3852577bc02ee5357 Aug 24 09:09:27.422803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-Tenant-Name: tempest-TestVolumeBootPattern-9404766 Aug 24 09:09:27.422803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User: tempest-TestVolumeBootPattern-9404766-project Aug 24 09:09:27.422803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Id: default Aug 24 09:09:27.422803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Domain-Name: Default Aug 24 09:09:27.422803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Id: 46b3aa99a5e84ef2a8df193628feb0d6 Aug 24 09:09:27.422803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: X-User-Name: tempest-TestVolumeBootPattern-9404766-project Aug 24 09:09:27.422803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: method: > Aug 24 09:09:27.422803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: exception: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. Aug 24 09:09:27.422803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: action_args: {'id': '2dff703e-fd9a-4783-9b0d-98337571e993'} Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:09:27.423987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. Aug 24 09:09:27.425627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR nova.api.openstack.wsgi Aug 24 09:09:27.427934 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-cd70e01d-64ed-4374-bb14-39e9eed00d45 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Returning 404 to user: Instance 2dff703e-fd9a-4783-9b0d-98337571e993 could not be found. {{(pid=120542) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:09:27.427934 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-cd70e01d-64ed-4374-bb14-39e9eed00d45 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993" status: 404 len: 111 microversion: 2.1 time: 0.029283 Aug 24 09:09:27.427934 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 696/1344] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:27 2022] GET /compute/v2.1/servers/2dff703e-fd9a-4783-9b0d-98337571e993 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:09:28.015793 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-59bf8b05-74ed-4590-9ea3-b27503e5232f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eab02dd0-7d60-4863-80bf-239d36566f55"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:09:28.018188 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-59bf8b05-74ed-4590-9ea3-b27503e5232f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:28.024299 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59bf8b05-74ed-4590-9ea3-b27503e5232f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:28.024783 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59bf8b05-74ed-4590-9ea3-b27503e5232f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:28.025218 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59bf8b05-74ed-4590-9ea3-b27503e5232f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:28.025906 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59bf8b05-74ed-4590-9ea3-b27503e5232f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:28.026359 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59bf8b05-74ed-4590-9ea3-b27503e5232f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:28.026779 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-59bf8b05-74ed-4590-9ea3-b27503e5232f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:28.271663 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-59bf8b05-74ed-4590-9ea3-b27503e5232f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "POST /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259587 Aug 24 09:09:28.272313 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 649/1345] 10.222.0.67 () {60 vars in 1323 bytes} [Wed Aug 24 09:09:28 2022] POST /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:09:28.725769 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-dae6422c-2cb5-4430-8ac3-f8cb9b690077 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] Calling method '.version_select at 0x7fb140ef8670>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:28.746541 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-dae6422c-2cb5-4430-8ac3-f8cb9b690077 tempest-TestVolumeBootPattern-9404766 tempest-TestVolumeBootPattern-9404766-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1984818663" status: 202 len: 0 microversion: 2.1 time: 0.024270 Aug 24 09:09:28.750170 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 697/1346] 10.222.0.67 () {58 vars in 1263 bytes} [Wed Aug 24 09:09:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1984818663 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:09:35.923917 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-74097d28-2842-4a58-8716-69cb87158589 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:35.926622 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-74097d28-2842-4a58-8716-69cb87158589 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:35.932660 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74097d28-2842-4a58-8716-69cb87158589 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:35.933144 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74097d28-2842-4a58-8716-69cb87158589 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:35.933574 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74097d28-2842-4a58-8716-69cb87158589 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:35.934268 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74097d28-2842-4a58-8716-69cb87158589 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:35.934716 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74097d28-2842-4a58-8716-69cb87158589 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:35.935138 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-74097d28-2842-4a58-8716-69cb87158589 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:35.958382 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:36.092167 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-74097d28-2842-4a58-8716-69cb87158589 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:36.101245 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-74097d28-2842-4a58-8716-69cb87158589 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1593 microversion: 2.1 time: 0.182992 Aug 24 09:09:36.101809 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 650/1347] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:35 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1593 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:09:37.912821 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell0:SELECT=2 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:37.912821 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:37.915184 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-aefaae32-273d-4931-a182-ae3f4fb9605b req-b847976b-2250-4438-8324-13c15485eddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d57831c4-c9d8-4d05-97fb-e0bc7194aa91", "tag": "467245bc-1a7c-4b72-99df-9f2fe2bf442f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:09:37.926779 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-aefaae32-273d-4931-a182-ae3f4fb9605b req-b847976b-2250-4438-8324-13c15485eddf service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:37.927259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-aefaae32-273d-4931-a182-ae3f4fb9605b req-b847976b-2250-4438-8324-13c15485eddf service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:37.927697 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-aefaae32-273d-4931-a182-ae3f4fb9605b req-b847976b-2250-4438-8324-13c15485eddf service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:37.938818 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-aefaae32-273d-4931-a182-ae3f4fb9605b req-b847976b-2250-4438-8324-13c15485eddf service nova] Creating event network-changed:467245bc-1a7c-4b72-99df-9f2fe2bf442f for instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 on hv-cinder-83538 Aug 24 09:09:37.946062 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-aefaae32-273d-4931-a182-ae3f4fb9605b req-b847976b-2250-4438-8324-13c15485eddf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036851 Aug 24 09:09:37.946860 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 698/1348] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:09:39.007858 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-d5c458c4-1a7e-49f4-8d7c-846d4b1ee1ca tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-772302093"}} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:09:39.009003 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-d5c458c4-1a7e-49f4-8d7c-846d4b1ee1ca tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:39.015837 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5c458c4-1a7e-49f4-8d7c-846d4b1ee1ca tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:39.016363 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5c458c4-1a7e-49f4-8d7c-846d4b1ee1ca tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:39.016813 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5c458c4-1a7e-49f4-8d7c-846d4b1ee1ca tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:39.017514 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5c458c4-1a7e-49f4-8d7c-846d4b1ee1ca tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:39.018759 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5c458c4-1a7e-49f4-8d7c-846d4b1ee1ca tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:39.019338 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-d5c458c4-1a7e-49f4-8d7c-846d4b1ee1ca tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:39.147823 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.network.security_group_api [None req-d5c458c4-1a7e-49f4-8d7c-846d4b1ee1ca tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Adding security group bff8020a-8ed7-4dba-9549-688e57949d09 to port 467245bc-1a7c-4b72-99df-9f2fe2bf442f Aug 24 09:09:39.462281 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-d5c458c4-1a7e-49f4-8d7c-846d4b1ee1ca tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "POST /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/action" status: 202 len: 0 microversion: 2.1 time: 0.458272 Aug 24 09:09:39.463480 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 651/1349] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 24 09:09:39 2022] POST /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:09:39.471627 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-504b13ac-5d9f-45ed-832e-44f983049f13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:09:39.472621 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-504b13ac-5d9f-45ed-832e-44f983049f13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:09:39.474510 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-9910aef5-1021-4838-94cc-dc4e02ad2208 req-c89e1aea-5113-4254-8e5a-357100a98440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d57831c4-c9d8-4d05-97fb-e0bc7194aa91", "tag": "467245bc-1a7c-4b72-99df-9f2fe2bf442f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:09:39.479815 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-504b13ac-5d9f-45ed-832e-44f983049f13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:39.480712 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-504b13ac-5d9f-45ed-832e-44f983049f13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:39.481420 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-504b13ac-5d9f-45ed-832e-44f983049f13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:39.482328 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-504b13ac-5d9f-45ed-832e-44f983049f13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:39.482980 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-504b13ac-5d9f-45ed-832e-44f983049f13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:39.483600 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-504b13ac-5d9f-45ed-832e-44f983049f13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:39.489472 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9910aef5-1021-4838-94cc-dc4e02ad2208 req-c89e1aea-5113-4254-8e5a-357100a98440 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:09:39.490001 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9910aef5-1021-4838-94cc-dc4e02ad2208 req-c89e1aea-5113-4254-8e5a-357100a98440 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:09:39.492140 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-9910aef5-1021-4838-94cc-dc4e02ad2208 req-c89e1aea-5113-4254-8e5a-357100a98440 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:09:39.511673 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-9910aef5-1021-4838-94cc-dc4e02ad2208 req-c89e1aea-5113-4254-8e5a-357100a98440 service nova] Creating event network-changed:467245bc-1a7c-4b72-99df-9f2fe2bf442f for instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 on hv-cinder-83538 Aug 24 09:09:39.521309 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-9910aef5-1021-4838-94cc-dc4e02ad2208 req-c89e1aea-5113-4254-8e5a-357100a98440 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054311 Aug 24 09:09:39.523211 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 699/1350] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:09:39.748767 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-504b13ac-5d9f-45ed-832e-44f983049f13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:09:39.761041 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-504b13ac-5d9f-45ed-832e-44f983049f13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1758 microversion: 2.1 time: 0.293534 Aug 24 09:09:39.761950 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 652/1351] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:09:39 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1758 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:40.284648 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:10:40.285412 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=4 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:10:40.289679 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-c5485840-ce52-4a4f-ae21-8332fd6ee7cc tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:10:40.292684 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-c5485840-ce52-4a4f-ae21-8332fd6ee7cc tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:40.299905 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5485840-ce52-4a4f-ae21-8332fd6ee7cc tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:40.300412 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5485840-ce52-4a4f-ae21-8332fd6ee7cc tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:40.300845 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5485840-ce52-4a4f-ae21-8332fd6ee7cc tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:40.301606 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5485840-ce52-4a4f-ae21-8332fd6ee7cc tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:40.302059 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5485840-ce52-4a4f-ae21-8332fd6ee7cc tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:40.302477 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-c5485840-ce52-4a4f-ae21-8332fd6ee7cc tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:40.376976 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-c5485840-ce52-4a4f-ae21-8332fd6ee7cc tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "POST /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/action" status: 202 len: 0 microversion: 2.1 time: 0.093947 Aug 24 09:10:40.377656 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 700/1352] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 24 09:10:40 2022] POST /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:10:40.384671 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=37 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:10:40.385531 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=12 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:10:40.389697 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8632ded4-0bdf-4f64-a950-1bce3cc5bf13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:40.390364 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8632ded4-0bdf-4f64-a950-1bce3cc5bf13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:40.397332 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8632ded4-0bdf-4f64-a950-1bce3cc5bf13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:40.397825 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8632ded4-0bdf-4f64-a950-1bce3cc5bf13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:40.398266 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8632ded4-0bdf-4f64-a950-1bce3cc5bf13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:40.399107 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8632ded4-0bdf-4f64-a950-1bce3cc5bf13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:40.399574 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8632ded4-0bdf-4f64-a950-1bce3cc5bf13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:40.400007 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8632ded4-0bdf-4f64-a950-1bce3cc5bf13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:40.809912 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-8632ded4-0bdf-4f64-a950-1bce3cc5bf13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:40.818047 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8632ded4-0bdf-4f64-a950-1bce3cc5bf13 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1750 microversion: 2.1 time: 0.435038 Aug 24 09:10:40.818607 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 653/1353] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:40 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1750 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:41.842058 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5142b970-5b25-4283-9fb8-54cb1767af17 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:41.842793 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5142b970-5b25-4283-9fb8-54cb1767af17 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:41.848960 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5142b970-5b25-4283-9fb8-54cb1767af17 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:41.849448 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5142b970-5b25-4283-9fb8-54cb1767af17 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:41.849888 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5142b970-5b25-4283-9fb8-54cb1767af17 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:41.850580 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5142b970-5b25-4283-9fb8-54cb1767af17 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:41.851039 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5142b970-5b25-4283-9fb8-54cb1767af17 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:41.851468 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5142b970-5b25-4283-9fb8-54cb1767af17 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:42.050490 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5142b970-5b25-4283-9fb8-54cb1767af17 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:42.058758 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5142b970-5b25-4283-9fb8-54cb1767af17 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1755 microversion: 2.1 time: 0.222220 Aug 24 09:10:42.059321 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 701/1354] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:41 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1755 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:43.079899 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-64adf55e-97a6-4f00-a65d-770c3c97f2c4 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:43.080492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-64adf55e-97a6-4f00-a65d-770c3c97f2c4 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:43.087171 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64adf55e-97a6-4f00-a65d-770c3c97f2c4 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:43.087656 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64adf55e-97a6-4f00-a65d-770c3c97f2c4 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:43.088296 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64adf55e-97a6-4f00-a65d-770c3c97f2c4 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:43.088804 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64adf55e-97a6-4f00-a65d-770c3c97f2c4 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:43.089259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64adf55e-97a6-4f00-a65d-770c3c97f2c4 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:43.089688 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-64adf55e-97a6-4f00-a65d-770c3c97f2c4 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:43.230462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-64adf55e-97a6-4f00-a65d-770c3c97f2c4 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:43.238777 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-64adf55e-97a6-4f00-a65d-770c3c97f2c4 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1755 microversion: 2.1 time: 0.162923 Aug 24 09:10:43.239363 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 654/1355] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:43 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:44.260709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-75531774-aa04-4a97-9492-52f267528bfd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:44.261343 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-75531774-aa04-4a97-9492-52f267528bfd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:44.267787 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75531774-aa04-4a97-9492-52f267528bfd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:44.268295 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75531774-aa04-4a97-9492-52f267528bfd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:44.268726 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75531774-aa04-4a97-9492-52f267528bfd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:44.269407 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75531774-aa04-4a97-9492-52f267528bfd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:44.269885 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75531774-aa04-4a97-9492-52f267528bfd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:44.270274 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-75531774-aa04-4a97-9492-52f267528bfd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:44.412570 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-75531774-aa04-4a97-9492-52f267528bfd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:44.420725 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-75531774-aa04-4a97-9492-52f267528bfd tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1755 microversion: 2.1 time: 0.164472 Aug 24 09:10:44.421290 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 702/1356] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:44 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:45.442225 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1166fe3a-362a-4378-bd35-11a5eaa8ae7b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:45.442845 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1166fe3a-362a-4378-bd35-11a5eaa8ae7b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:45.449441 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1166fe3a-362a-4378-bd35-11a5eaa8ae7b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:45.449940 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1166fe3a-362a-4378-bd35-11a5eaa8ae7b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:45.450379 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1166fe3a-362a-4378-bd35-11a5eaa8ae7b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:45.451078 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1166fe3a-362a-4378-bd35-11a5eaa8ae7b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:45.451542 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1166fe3a-362a-4378-bd35-11a5eaa8ae7b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:45.451971 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1166fe3a-362a-4378-bd35-11a5eaa8ae7b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:45.595595 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1166fe3a-362a-4378-bd35-11a5eaa8ae7b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:45.604437 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1166fe3a-362a-4378-bd35-11a5eaa8ae7b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1755 microversion: 2.1 time: 0.165583 Aug 24 09:10:45.604997 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 655/1357] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:45 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:46.625300 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-86fa8da5-2488-44a6-9551-c5b9340c4931 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:46.625919 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-86fa8da5-2488-44a6-9551-c5b9340c4931 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:46.633983 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86fa8da5-2488-44a6-9551-c5b9340c4931 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:46.634474 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86fa8da5-2488-44a6-9551-c5b9340c4931 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:46.635415 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86fa8da5-2488-44a6-9551-c5b9340c4931 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:46.636143 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86fa8da5-2488-44a6-9551-c5b9340c4931 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:46.638431 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86fa8da5-2488-44a6-9551-c5b9340c4931 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:46.638876 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-86fa8da5-2488-44a6-9551-c5b9340c4931 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:46.783489 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-86fa8da5-2488-44a6-9551-c5b9340c4931 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:46.791688 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-86fa8da5-2488-44a6-9551-c5b9340c4931 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1755 microversion: 2.1 time: 0.170268 Aug 24 09:10:46.792287 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 703/1358] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:46 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:47.812439 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-91a8dec9-9914-43d4-bdef-ec7ed6f4538a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:47.813061 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-91a8dec9-9914-43d4-bdef-ec7ed6f4538a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:47.819505 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91a8dec9-9914-43d4-bdef-ec7ed6f4538a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:47.820016 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91a8dec9-9914-43d4-bdef-ec7ed6f4538a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:47.820498 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91a8dec9-9914-43d4-bdef-ec7ed6f4538a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:47.821194 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91a8dec9-9914-43d4-bdef-ec7ed6f4538a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:47.821653 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91a8dec9-9914-43d4-bdef-ec7ed6f4538a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:47.822725 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-91a8dec9-9914-43d4-bdef-ec7ed6f4538a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:47.966705 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-91a8dec9-9914-43d4-bdef-ec7ed6f4538a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:47.975118 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-91a8dec9-9914-43d4-bdef-ec7ed6f4538a tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1755 microversion: 2.1 time: 0.166772 Aug 24 09:10:47.975693 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 656/1359] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:47 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:48.995922 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-9921cbca-ca0d-4718-ae53-b42cc7ba6a74 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:48.996533 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-9921cbca-ca0d-4718-ae53-b42cc7ba6a74 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:49.002897 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9921cbca-ca0d-4718-ae53-b42cc7ba6a74 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:49.003385 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9921cbca-ca0d-4718-ae53-b42cc7ba6a74 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:49.003825 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9921cbca-ca0d-4718-ae53-b42cc7ba6a74 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:49.004549 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9921cbca-ca0d-4718-ae53-b42cc7ba6a74 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:49.005009 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9921cbca-ca0d-4718-ae53-b42cc7ba6a74 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:49.005440 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-9921cbca-ca0d-4718-ae53-b42cc7ba6a74 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:49.145862 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-9921cbca-ca0d-4718-ae53-b42cc7ba6a74 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:49.154206 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-9921cbca-ca0d-4718-ae53-b42cc7ba6a74 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1755 microversion: 2.1 time: 0.162438 Aug 24 09:10:49.154762 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 704/1360] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:48 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:50.176259 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-14383dbd-4798-4e8e-8897-8f99e85e8747 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:50.176862 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-14383dbd-4798-4e8e-8897-8f99e85e8747 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:50.183639 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14383dbd-4798-4e8e-8897-8f99e85e8747 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:50.184227 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14383dbd-4798-4e8e-8897-8f99e85e8747 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:50.184907 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14383dbd-4798-4e8e-8897-8f99e85e8747 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:50.185807 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14383dbd-4798-4e8e-8897-8f99e85e8747 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:50.186327 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14383dbd-4798-4e8e-8897-8f99e85e8747 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:50.187002 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-14383dbd-4798-4e8e-8897-8f99e85e8747 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:50.334032 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-14383dbd-4798-4e8e-8897-8f99e85e8747 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:50.342844 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-14383dbd-4798-4e8e-8897-8f99e85e8747 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1755 microversion: 2.1 time: 0.171488 Aug 24 09:10:50.343412 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 657/1361] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:50 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:51.362627 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-8c2b874e-b12e-461c-8fdc-40707e7301b8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:51.363243 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-8c2b874e-b12e-461c-8fdc-40707e7301b8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:51.370126 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c2b874e-b12e-461c-8fdc-40707e7301b8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:51.370612 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c2b874e-b12e-461c-8fdc-40707e7301b8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:51.371056 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c2b874e-b12e-461c-8fdc-40707e7301b8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:51.371754 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c2b874e-b12e-461c-8fdc-40707e7301b8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:51.372259 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c2b874e-b12e-461c-8fdc-40707e7301b8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:51.372692 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-8c2b874e-b12e-461c-8fdc-40707e7301b8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:51.512532 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-8c2b874e-b12e-461c-8fdc-40707e7301b8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:51.520631 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-8c2b874e-b12e-461c-8fdc-40707e7301b8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1755 microversion: 2.1 time: 0.161862 Aug 24 09:10:51.521204 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 705/1362] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:51 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:10:52.510536 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:10:52.511076 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Wed Aug 24 09:10:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:10:52.542339 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-57977d3e-a6d4-4fb4-aada-d0bfcc449136 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:10:52.542978 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-57977d3e-a6d4-4fb4-aada-d0bfcc449136 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:10:52.549565 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57977d3e-a6d4-4fb4-aada-d0bfcc449136 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:52.550051 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57977d3e-a6d4-4fb4-aada-d0bfcc449136 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:52.550486 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57977d3e-a6d4-4fb4-aada-d0bfcc449136 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:52.551180 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57977d3e-a6d4-4fb4-aada-d0bfcc449136 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:10:52.551637 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57977d3e-a6d4-4fb4-aada-d0bfcc449136 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:10:52.552065 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-57977d3e-a6d4-4fb4-aada-d0bfcc449136 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:10:52.690730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-57977d3e-a6d4-4fb4-aada-d0bfcc449136 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:10:52.699222 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-57977d3e-a6d4-4fb4-aada-d0bfcc449136 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1758 microversion: 2.1 time: 0.161537 Aug 24 09:10:52.699779 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 658/1363] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:10:52 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:11:56.141912 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_api:SELECT=12 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:11:56.142803 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG dbcounter [-] [120542] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:11:56.147349 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-acd43dbf-cd95-41f1-8af3-e6484be6d00e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-772302093"}} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:11:56.148362 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-acd43dbf-cd95-41f1-8af3-e6484be6d00e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:11:56.159699 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-acd43dbf-cd95-41f1-8af3-e6484be6d00e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:11:56.160405 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-acd43dbf-cd95-41f1-8af3-e6484be6d00e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:11:56.160877 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-acd43dbf-cd95-41f1-8af3-e6484be6d00e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:11:56.161586 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-acd43dbf-cd95-41f1-8af3-e6484be6d00e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:11:56.162039 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-acd43dbf-cd95-41f1-8af3-e6484be6d00e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:11:56.163482 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-acd43dbf-cd95-41f1-8af3-e6484be6d00e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:11:56.329190 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.network.security_group_api [None req-acd43dbf-cd95-41f1-8af3-e6484be6d00e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Removing security group bff8020a-8ed7-4dba-9549-688e57949d09 from port 467245bc-1a7c-4b72-99df-9f2fe2bf442f Aug 24 09:11:56.697973 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-acd43dbf-cd95-41f1-8af3-e6484be6d00e tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "POST /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/action" status: 202 len: 0 microversion: 2.1 time: 0.557431 Aug 24 09:11:56.703987 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 706/1364] 10.222.0.67 () {60 vars in 1278 bytes} [Wed Aug 24 09:11:56 2022] POST /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:11:56.704668 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_api:SELECT=12 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:11:56.706344 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG dbcounter [-] [120543] Writing DB stats nova_cell1:SELECT=36 {{(pid=120543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:11:56.792626 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-0cd3d91f-df39-44a8-a9e1-cc1ad7defd9e req-35187c84-32a6-4936-ae75-a9663ca020b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d57831c4-c9d8-4d05-97fb-e0bc7194aa91", "tag": "467245bc-1a7c-4b72-99df-9f2fe2bf442f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:11:56.804056 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0cd3d91f-df39-44a8-a9e1-cc1ad7defd9e req-35187c84-32a6-4936-ae75-a9663ca020b3 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:11:56.804619 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0cd3d91f-df39-44a8-a9e1-cc1ad7defd9e req-35187c84-32a6-4936-ae75-a9663ca020b3 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:11:56.805307 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-0cd3d91f-df39-44a8-a9e1-cc1ad7defd9e req-35187c84-32a6-4936-ae75-a9663ca020b3 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:11:56.820854 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-0cd3d91f-df39-44a8-a9e1-cc1ad7defd9e req-35187c84-32a6-4936-ae75-a9663ca020b3 service nova] Creating event network-changed:467245bc-1a7c-4b72-99df-9f2fe2bf442f for instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 on hv-cinder-83538 Aug 24 09:11:56.827382 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-0cd3d91f-df39-44a8-a9e1-cc1ad7defd9e req-35187c84-32a6-4936-ae75-a9663ca020b3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125317 Aug 24 09:11:56.828416 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 659/1365] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:11:58.112210 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-d0e544f5-7685-4739-8918-6eaad5da9921 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:11:58.112745 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-d0e544f5-7685-4739-8918-6eaad5da9921 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:11:58.119662 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0e544f5-7685-4739-8918-6eaad5da9921 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:11:58.120347 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0e544f5-7685-4739-8918-6eaad5da9921 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:11:58.121090 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0e544f5-7685-4739-8918-6eaad5da9921 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:11:58.121862 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0e544f5-7685-4739-8918-6eaad5da9921 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:11:58.122391 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0e544f5-7685-4739-8918-6eaad5da9921 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:11:58.122886 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-d0e544f5-7685-4739-8918-6eaad5da9921 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:11:58.177127 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [req-560c2e3e-7f9d-42b1-8035-a3287525c815 req-d3e5835f-b5cf-42a9-9f19-0b2f718c202e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d57831c4-c9d8-4d05-97fb-e0bc7194aa91", "tag": "467245bc-1a7c-4b72-99df-9f2fe2bf442f"}]} {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:11:58.188694 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-560c2e3e-7f9d-42b1-8035-a3287525c815 req-d3e5835f-b5cf-42a9-9f19-0b2f718c202e service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:11:58.189245 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-560c2e3e-7f9d-42b1-8035-a3287525c815 req-d3e5835f-b5cf-42a9-9f19-0b2f718c202e service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:11:58.189764 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [req-560c2e3e-7f9d-42b1-8035-a3287525c815 req-d3e5835f-b5cf-42a9-9f19-0b2f718c202e service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:11:58.202566 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.compute.server_external_events [req-560c2e3e-7f9d-42b1-8035-a3287525c815 req-d3e5835f-b5cf-42a9-9f19-0b2f718c202e service nova] Creating event network-changed:467245bc-1a7c-4b72-99df-9f2fe2bf442f for instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 on hv-cinder-83538 Aug 24 09:11:58.207848 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [req-560c2e3e-7f9d-42b1-8035-a3287525c815 req-d3e5835f-b5cf-42a9-9f19-0b2f718c202e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098662 Aug 24 09:11:58.208783 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 660/1366] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:11:58.210914 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.objects.instance [None req-d0e544f5-7685-4739-8918-6eaad5da9921 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lazy-loading 'services' on Instance uuid d57831c4-c9d8-4d05-97fb-e0bc7194aa91 {{(pid=120542) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:11:58.286598 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-d0e544f5-7685-4739-8918-6eaad5da9921 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/os-volume_attachments/eab02dd0-7d60-4863-80bf-239d36566f55" status: 202 len: 0 microversion: 2.1 time: 0.179888 Aug 24 09:11:58.287385 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 707/1367] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 24 09:11:58 2022] DELETE /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/os-volume_attachments/eab02dd0-7d60-4863-80bf-239d36566f55 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:11:58.298806 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-3a1d68e7-0a97-4dda-bd8d-58371a15424b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:11:58.302091 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-3a1d68e7-0a97-4dda-bd8d-58371a15424b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:11:58.310423 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a1d68e7-0a97-4dda-bd8d-58371a15424b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:11:58.310918 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a1d68e7-0a97-4dda-bd8d-58371a15424b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:11:58.311407 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a1d68e7-0a97-4dda-bd8d-58371a15424b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:11:58.312142 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a1d68e7-0a97-4dda-bd8d-58371a15424b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:11:58.312607 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a1d68e7-0a97-4dda-bd8d-58371a15424b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:11:58.313037 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-3a1d68e7-0a97-4dda-bd8d-58371a15424b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:11:58.345018 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-3a1d68e7-0a97-4dda-bd8d-58371a15424b tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051075 Aug 24 09:11:58.345969 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 661/1368] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:11:58 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:11:59.359011 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-fc3afc5e-7578-47ad-8a67-d6c073e3911f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:11:59.361237 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-fc3afc5e-7578-47ad-8a67-d6c073e3911f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:11:59.367779 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc3afc5e-7578-47ad-8a67-d6c073e3911f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:11:59.368364 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc3afc5e-7578-47ad-8a67-d6c073e3911f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:11:59.368820 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc3afc5e-7578-47ad-8a67-d6c073e3911f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:11:59.369575 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc3afc5e-7578-47ad-8a67-d6c073e3911f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:11:59.370031 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc3afc5e-7578-47ad-8a67-d6c073e3911f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:11:59.370456 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-fc3afc5e-7578-47ad-8a67-d6c073e3911f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:11:59.398570 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-fc3afc5e-7578-47ad-8a67-d6c073e3911f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044451 Aug 24 09:11:59.399112 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 708/1369] 10.222.0.67 () {58 vars in 1302 bytes} [Wed Aug 24 09:11:59 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:11:59.410228 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8a070cca-e477-4d16-a09b-53df40d779f8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:11:59.410735 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-8a070cca-e477-4d16-a09b-53df40d779f8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:11:59.417249 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a070cca-e477-4d16-a09b-53df40d779f8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:11:59.417739 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a070cca-e477-4d16-a09b-53df40d779f8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:11:59.418175 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a070cca-e477-4d16-a09b-53df40d779f8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:11:59.418867 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a070cca-e477-4d16-a09b-53df40d779f8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:11:59.419321 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a070cca-e477-4d16-a09b-53df40d779f8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:11:59.419747 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-8a070cca-e477-4d16-a09b-53df40d779f8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:11:59.494080 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-8a070cca-e477-4d16-a09b-53df40d779f8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] HTTP exception thrown: Instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 is not attached to volume eab02dd0-7d60-4863-80bf-239d36566f55 Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8a070cca-e477-4d16-a09b-53df40d779f8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Request method failure captured: Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: DELETE /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/os-volume_attachments/eab02dd0-7d60-4863-80bf-239d36566f55 HTTP/1.1 Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeqOKZ_OUCQcHniZC4xg9OB2bEdOoM5ZQDEtXfAC1yoM7FXv9TAwL3-46gCmYtOEL6CwLvGRnxNQGJV6rdXZEaIl3Gi5YTkVyJZ7Qm7mbyGeqLbfgNxneHMrE6VU3Tt08-Bx6Amj6WrWL_QnCd-H8CnApeGZHvtvlQPQrmkkS4KguZs Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 759df091a0664e68b9f38eec1f9c2e49 Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-TestMinimumBasicScenario-819176533 Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:11:59.496450 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:11:59.498492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_759df091a0664e68b9f38eec1f9c2e49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/759df091a0664e68b9f38eec1f9c2e49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/759df091a0664e68b9f38eec1f9c2e49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/759df091a0664e68b9f38eec1f9c2e49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:11:59.498492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-TestMinimumBasicScenario-819176533 Aug 24 09:11:59.498492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 759df091a0664e68b9f38eec1f9c2e49 Aug 24 09:11:59.498492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestMinimumBasicScenario-819176533 Aug 24 09:11:59.498492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-TestMinimumBasicScenario-819176533-project Aug 24 09:11:59.498492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:11:59.498492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:11:59.498492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: 517a70383bcd42eba23483981dd40d89 Aug 24 09:11:59.498492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-TestMinimumBasicScenario-819176533-project Aug 24 09:11:59.498492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:11:59.498492 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 is not attached to volume eab02dd0-7d60-4863-80bf-239d36566f55 Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'server_id': 'd57831c4-c9d8-4d05-97fb-e0bc7194aa91', 'id': 'eab02dd0-7d60-4863-80bf-239d36566f55'} Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id eab02dd0-7d60-4863-80bf-239d36566f55. Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:11:59.499533 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:11:59.501193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:11:59.501193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 09:11:59.501193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 09:11:59.501193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 is not attached to volume eab02dd0-7d60-4863-80bf-239d36566f55 Aug 24 09:11:59.501193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:11:59.501193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:11:59.501193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:11:59.501193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:11:59.501193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:11:59.501193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:11:59.501193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:11:59.501193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:11:59.501193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 is not attached to volume eab02dd0-7d60-4863-80bf-239d36566f55 Aug 24 09:11:59.501193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:11:59.501193 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-8a070cca-e477-4d16-a09b-53df40d779f8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Returning 404 to user: Instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 is not attached to volume eab02dd0-7d60-4863-80bf-239d36566f55 {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:11:59.502414 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-8a070cca-e477-4d16-a09b-53df40d779f8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/os-volume_attachments/eab02dd0-7d60-4863-80bf-239d36566f55" status: 404 len: 154 microversion: 2.1 time: 0.091676 Aug 24 09:11:59.502414 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 662/1370] 10.222.0.67 () {58 vars in 1416 bytes} [Wed Aug 24 09:11:59 2022] DELETE /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91/os-volume_attachments/eab02dd0-7d60-4863-80bf-239d36566f55 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:12:00.637245 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-34283e8f-9108-48c3-a908-daa5a37b3fa7 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:12:00.637741 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-34283e8f-9108-48c3-a908-daa5a37b3fa7 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:12:00.643957 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34283e8f-9108-48c3-a908-daa5a37b3fa7 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:00.644469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34283e8f-9108-48c3-a908-daa5a37b3fa7 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:00.644897 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34283e8f-9108-48c3-a908-daa5a37b3fa7 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:00.645578 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34283e8f-9108-48c3-a908-daa5a37b3fa7 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:00.646026 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34283e8f-9108-48c3-a908-daa5a37b3fa7 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:00.646443 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-34283e8f-9108-48c3-a908-daa5a37b3fa7 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:00.672158 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-34283e8f-9108-48c3-a908-daa5a37b3fa7 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Going to try to terminate instance {{(pid=120542) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:12:00.749204 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-34283e8f-9108-48c3-a908-daa5a37b3fa7 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 204 len: 0 microversion: 2.1 time: 0.115922 Aug 24 09:12:00.749794 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 709/1371] 10.222.0.67 () {58 vars in 1239 bytes} [Wed Aug 24 09:12:00 2022] DELETE /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:12:00.758399 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-1be279f7-affd-44f8-976c-960b93fdb0a9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:12:00.759620 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-1be279f7-affd-44f8-976c-960b93fdb0a9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:12:00.766057 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be279f7-affd-44f8-976c-960b93fdb0a9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:00.766539 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be279f7-affd-44f8-976c-960b93fdb0a9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:00.766968 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be279f7-affd-44f8-976c-960b93fdb0a9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:00.767652 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be279f7-affd-44f8-976c-960b93fdb0a9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:00.768119 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be279f7-affd-44f8-976c-960b93fdb0a9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:00.768544 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-1be279f7-affd-44f8-976c-960b93fdb0a9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:00.899770 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-1be279f7-affd-44f8-976c-960b93fdb0a9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:12:00.907577 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-1be279f7-affd-44f8-976c-960b93fdb0a9 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1553 microversion: 2.1 time: 0.153000 Aug 24 09:12:00.908146 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 663/1372] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:12:00 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:12:01.929305 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-5d0eeaff-ec4a-4d2a-9485-e45d05b630c0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:12:01.929923 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.compute.api [None req-5d0eeaff-ec4a-4d2a-9485-e45d05b630c0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120542) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:12:01.937108 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d0eeaff-ec4a-4d2a-9485-e45d05b630c0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:01.937587 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d0eeaff-ec4a-4d2a-9485-e45d05b630c0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:01.938026 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d0eeaff-ec4a-4d2a-9485-e45d05b630c0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:01.938709 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d0eeaff-ec4a-4d2a-9485-e45d05b630c0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:01.939162 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d0eeaff-ec4a-4d2a-9485-e45d05b630c0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:01.939580 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [None req-5d0eeaff-ec4a-4d2a-9485-e45d05b630c0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:02.068277 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.policy [None req-5d0eeaff-ec4a-4d2a-9485-e45d05b630c0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120542) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:12:02.077160 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-5d0eeaff-ec4a-4d2a-9485-e45d05b630c0 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1553 microversion: 2.1 time: 0.152086 Aug 24 09:12:02.077741 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 710/1373] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:12:01 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:12:03.099829 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-c5596775-ea02-4f37-a0b1-a8d81cf54a2f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:12:03.100717 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-c5596775-ea02-4f37-a0b1-a8d81cf54a2f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:12:03.108322 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5596775-ea02-4f37-a0b1-a8d81cf54a2f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:03.108828 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5596775-ea02-4f37-a0b1-a8d81cf54a2f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:03.109490 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5596775-ea02-4f37-a0b1-a8d81cf54a2f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:03.110198 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5596775-ea02-4f37-a0b1-a8d81cf54a2f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:03.110662 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5596775-ea02-4f37-a0b1-a8d81cf54a2f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:03.111087 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-c5596775-ea02-4f37-a0b1-a8d81cf54a2f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:03.202079 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.policy [None req-c5596775-ea02-4f37-a0b1-a8d81cf54a2f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517a70383bcd42eba23483981dd40d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759df091a0664e68b9f38eec1f9c2e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120543) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:12:03.210092 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-c5596775-ea02-4f37-a0b1-a8d81cf54a2f tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 200 len: 1511 microversion: 2.1 time: 0.114256 Aug 24 09:12:03.214650 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 664/1374] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:12:03 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 1511 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:12:03.240073 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [req-6663bc17-b3ba-4541-9d8d-3a52a5bd60ae req-e0105340-777a-4f4b-9ef7-3a70209e9842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d57831c4-c9d8-4d05-97fb-e0bc7194aa91", "name": "network-vif-deleted", "tag": "467245bc-1a7c-4b72-99df-9f2fe2bf442f"}]} {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:12:03.250033 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6663bc17-b3ba-4541-9d8d-3a52a5bd60ae req-e0105340-777a-4f4b-9ef7-3a70209e9842 service nova] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:03.250813 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6663bc17-b3ba-4541-9d8d-3a52a5bd60ae req-e0105340-777a-4f4b-9ef7-3a70209e9842 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:03.251250 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG oslo_concurrency.lockutils [req-6663bc17-b3ba-4541-9d8d-3a52a5bd60ae req-e0105340-777a-4f4b-9ef7-3a70209e9842 service nova] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120542) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:03.263549 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.compute.server_external_events [req-6663bc17-b3ba-4541-9d8d-3a52a5bd60ae req-e0105340-777a-4f4b-9ef7-3a70209e9842 service nova] Creating event network-vif-deleted:467245bc-1a7c-4b72-99df-9f2fe2bf442f for instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 on hv-cinder-83538 Aug 24 09:12:03.268479 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [req-6663bc17-b3ba-4541-9d8d-3a52a5bd60ae req-e0105340-777a-4f4b-9ef7-3a70209e9842 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031970 Aug 24 09:12:03.269081 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 711/1375] 10.222.0.67 () {64 vars in 1317 bytes} [Wed Aug 24 09:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:12:04.233900 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-166ae299-f913-456d-b98c-b9817879f9fe tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '>' {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:12:04.234538 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.compute.api [None req-166ae299-f913-456d-b98c-b9817879f9fe tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [instance: d57831c4-c9d8-4d05-97fb-e0bc7194aa91] Fetching instance by UUID {{(pid=120543) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:12:04.240974 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-166ae299-f913-456d-b98c-b9817879f9fe tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:04.241462 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-166ae299-f913-456d-b98c-b9817879f9fe tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:04.241901 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-166ae299-f913-456d-b98c-b9817879f9fe tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:04.242592 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-166ae299-f913-456d-b98c-b9817879f9fe tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Acquiring lock "494397f8-d04d-4a37-97c3-122ec902df53" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:12:04.244021 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-166ae299-f913-456d-b98c-b9817879f9fe tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:12:04.244543 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG oslo_concurrency.lockutils [None req-166ae299-f913-456d-b98c-b9817879f9fe tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Lock "494397f8-d04d-4a37-97c3-122ec902df53" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:12:04.257672 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.wsgi [None req-166ae299-f913-456d-b98c-b9817879f9fe tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] HTTP exception thrown: Instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 could not be found. Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-166ae299-f913-456d-b98c-b9817879f9fe tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Request method failure captured: Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: request: GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 HTTP/1.1 Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept: application/json Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Accept-Encoding: identity Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Connection: close Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Length: 0 Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Content-Type: application/json Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Host: 10.222.0.67 Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Openstack-System-Scope: None Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: User-Agent: python-urllib3/1.26.11 Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Auth-Token: gAAAAABjBeqOKZ_OUCQcHniZC4xg9OB2bEdOoM5ZQDEtXfAC1yoM7FXv9TAwL3-46gCmYtOEL6CwLvGRnxNQGJV6rdXZEaIl3Gi5YTkVyJZ7Qm7mbyGeqLbfgNxneHMrE6VU3Tt08-Bx6Amj6WrWL_QnCd-H8CnApeGZHvtvlQPQrmkkS4KguZs Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Id: None Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Domain-Name: None Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Identity-Status: Confirmed Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Is-Admin-Project: True Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Id: default Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Domain-Name: Default Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Id: 759df091a0664e68b9f38eec1f9c2e49 Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Project-Name: tempest-TestMinimumBasicScenario-819176533 Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Role: reader,member Aug 24 09:12:04.259224 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Roles: reader,member Aug 24 09:12:04.261031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_759df091a0664e68b9f38eec1f9c2e49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/759df091a0664e68b9f38eec1f9c2e49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/759df091a0664e68b9f38eec1f9c2e49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/759df091a0664e68b9f38eec1f9c2e49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}] Aug 24 09:12:04.261031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant: tempest-TestMinimumBasicScenario-819176533 Aug 24 09:12:04.261031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Id: 759df091a0664e68b9f38eec1f9c2e49 Aug 24 09:12:04.261031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-Tenant-Name: tempest-TestMinimumBasicScenario-819176533 Aug 24 09:12:04.261031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User: tempest-TestMinimumBasicScenario-819176533-project Aug 24 09:12:04.261031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Id: default Aug 24 09:12:04.261031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Domain-Name: Default Aug 24 09:12:04.261031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Id: 517a70383bcd42eba23483981dd40d89 Aug 24 09:12:04.261031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: X-User-Name: tempest-TestMinimumBasicScenario-819176533-project Aug 24 09:12:04.261031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: method: > Aug 24 09:12:04.261031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: exception: Instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 could not be found. Aug 24 09:12:04.261031 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: action_args: {'id': 'd57831c4-c9d8-4d05-97fb-e0bc7194aa91'} Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: {{(pid=120543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 could not be found. Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:12:04.262035 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 could not be found. Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 could not be found. Aug 24 09:12:04.263730 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: ERROR nova.api.openstack.wsgi Aug 24 09:12:04.265253 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: DEBUG nova.api.openstack.wsgi [None req-166ae299-f913-456d-b98c-b9817879f9fe tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Returning 404 to user: Instance d57831c4-c9d8-4d05-97fb-e0bc7194aa91 could not be found. {{(pid=120543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:12:04.265253 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO nova.api.openstack.requestlog [None req-166ae299-f913-456d-b98c-b9817879f9fe tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91" status: 404 len: 111 microversion: 2.1 time: 0.030678 Aug 24 09:12:04.265253 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: [pid: 120543|app: 0|req: 665/1376] 10.222.0.67 () {58 vars in 1236 bytes} [Wed Aug 24 09:12:04 2022] GET /compute/v2.1/servers/d57831c4-c9d8-4d05-97fb-e0bc7194aa91 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:12:04.270390 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: DEBUG nova.api.openstack.wsgi [None req-f27601ef-276d-4d13-8cb7-30dc6a5635b8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] Calling method '.version_select at 0x7fb140f0d5e0>' {{(pid=120542) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:12:04.275361 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f27601ef-276d-4d13-8cb7-30dc6a5635b8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [be4cfc5a-463d-4093-8b16-68efd08a8ab9] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 09:12:05.282429 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [None req-f27601ef-276d-4d13-8cb7-30dc6a5635b8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] [be4cfc5a-463d-4093-8b16-68efd08a8ab9] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 55180. Aug 24 09:12:05.300546 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO nova.api.openstack.requestlog [None req-f27601ef-276d-4d13-8cb7-30dc6a5635b8 tempest-TestMinimumBasicScenario-819176533 tempest-TestMinimumBasicScenario-819176533-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1889961013" status: 202 len: 0 microversion: 2.1 time: 1.034685 Aug 24 09:12:05.301123 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: [pid: 120542|app: 0|req: 712/1377] 10.222.0.67 () {58 vars in 1272 bytes} [Wed Aug 24 09:12:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1889961013 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:14:00.713947 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:14:00.714538 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Wed Aug 24 09:14:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:14:11.129469 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:14:11.130042 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Wed Aug 24 09:14:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:14:12.519071 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:14:12.519606 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Wed Aug 24 09:14:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:14:34.241519 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:14:34.242064 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Wed Aug 24 09:14:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:14:36.480863 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:14:36.481318 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Wed Aug 24 09:14:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:17:20.723398 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:17:20.724168 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Wed Aug 24 09:17:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:17:23.848965 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:17:23.849560 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Wed Aug 24 09:17:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:17:31.137586 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:17:31.138254 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Wed Aug 24 09:17:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:17:32.526905 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:17:32.527478 dv-cinder-835384-23-iscsi devstack@n-api.service[120543]: Wed Aug 24 09:17:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:17:54.250289 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:17:54.250883 dv-cinder-835384-23-iscsi devstack@n-api.service[120542]: Wed Aug 24 09:17:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!